00000001:02000400:0.0F:1789128878.474034:0:2958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1789128896.286426:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789128898.869092:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 559 MB/s 00000001:01000000:1.0F:1789128899.119027:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 555 MB/s 00000001:01000000:1.0:1789128899.368696:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3219 MB/s 00000020:02000000:1.0:1789128900.550457:0:3275:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_133_g066c38c 00000400:02000000:3.0:1789128901.886361:0:3290:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.139@tcp [8/256/0/180] 00008000:02000000:3.0:1789128906.196004:0:3440:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789128963.269358:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789128976.328175:0:5820:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789128976.328183:0:5820:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789128976.328375:0:5820:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000003a8dadc8 00000080:02000400:3.0:1789128976.328422:0:5820:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789128976.346652:0:5820:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789128976.346672:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789128976.346737:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000253827f5) 00000020:00000080:3.0:1789128976.346764:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789128976.409979:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789128976.410912:0:5820:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789128976.504596:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789128976.504874:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789128976.504897:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789128976.505430:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789128976.505478:0:5820:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789128976.506574:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789128976.506587:0:5820:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789128976.506774:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce3f65 00000020:01000004:3.0:1789128976.506785:0:5820:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789128976.506793:0:5820:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789128976.506798:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003a8dadc8 from MGS 00000020:01000004:3.0:1789128976.506804:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789128976.506817:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a580da9d) 00000020:00000080:3.0:1789128976.506829:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789128976.506891:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003a8dadc8 from MGS, refs=2 00080000:01000000:3.0:1789128976.506896:0:5820:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789128976.506901:0:5820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce3f73 00000100:00100000:3.0:1789128976.507395:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789128976.507653:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789128976.507661:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789128976.509332:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789128976.509354:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789128976.511054:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789128976.512289:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789128976.512298:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789128976.513431:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789128976.513442:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789128976.516578:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789128976.516893:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789128976.521539:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128976.521547:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128976.521550:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128976.521973:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128976.521976:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128976.521978:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789128976.523064:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789128976.526498:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789128976.772934:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1707 MB/s 00000001:01000000:1.0:1789128977.024373:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2103 MB/s 00000001:01000000:0.0:1789128977.280062:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 250 MB/s 00000001:01000000:1.0:1789128977.529694:0:5820:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 427 MB/s 00010000:00010000:3.0:1789128977.543538:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1789128977.557157:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789128977.608319:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789128977.608346:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789128977.608350:0:5820:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789128977.618300:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789128977.619919:0:5820:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789128977.619989:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789128977.620279:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789128977.620306:0:5820:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789128977.620797:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789128977.620996:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789128977.621011:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789128977.623244:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789128977.623261:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789128977.624704:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789128977.624718:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789128977.626951:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789128977.626979:0:5820:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.139@tcp' 00000020:01000004:2.0:1789128977.626981:0:5820:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789128977.627029:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.139@tcp (typ=mgc) 00000020:00000080:2.0:1789128977.627055:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.139@tcp (000000000bd9b8db) 00000020:00000080:2.0:1789128977.627075:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789128977.627506:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000864fb535@MGC192.168.201.139@tcp: add connection 192.168.201.139@tcp at head 00010000:00010000:2.0:1789128977.627720:0:5820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.139@tcp-0 is initialized 00000040:01000000:2.0:1789128977.627729:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789128977.628296:0:5836:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789128977.628680:0:5837:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789128977.628713:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.139@tcp (uuid 4a927c41-01d5-424a-b17c-4bdb2d4e760d) 00000020:00000080:1.0:1789128977.628732:0:5820:0:(genops.c:1385:class_connect()) connect: client 4a927c41-01d5-424a-b17c-4bdb2d4e760d, cookie 0x5c74554e47ce3f81 00000100:00080000:1.0:1789128977.628745:0:5820:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789128977.628750:0:5820:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import 00000000864fb535 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789128977.628783:0:5820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000759e538c x1876037626495104/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789128977.628881:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000759e538c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3305:1876037626495104:0@lo:250: 00000100:00100000:1.0:1789128977.628961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128977.629030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626495104 00000100:00100000:1.0:1789128977.629037:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626495104 00000100:00100000:1.0:1789128977.629078:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789128977.629085:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003436c40c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1876037626495104:12345-0@lo:250: 00010000:00080000:1.0:1789128977.629106:0:5833:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 4a927c41-01d5-424a-b17c-4bdb2d4e760d@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:1.0:1789128977.629684:0:5833:0:(genops.c:1385:class_connect()) connect: client 4a927c41-01d5-424a-b17c-4bdb2d4e760d, cookie 0x5c74554e47ce3f88 00000100:00080000:1.0:1789128977.629834:0:5833:0:(import.c:65:import_set_state_nolock()) 00000000c63ef60a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789128977.629901:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003436c40c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:3305:x1876037626495104:12345-0@lo:250: Request processed in 815us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789128977.629908:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789128977.629944:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4a927c41-01d5-424a-b17c-4bdb2d4e760d->MGS 00000020:01000004:1.0:1789128977.629963:0:5820:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789128977.629970:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789128977.629993:0:5820:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000009a4aa9c8) 00000020:00000080:1.0:1789128977.630005:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789128977.630432:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789128977.630442:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.139@tcp: connect to target with instance 0 00000100:00080000:0.0:1789128977.630449:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789128977.630453:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789128977.630456:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000864fb535 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789128977.630458:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789128977.630461:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789128977.630466:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000759e538c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3305:1876037626495104:0@lo:250: 00000100:00100000:1.0:1789128977.675244:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789128977.675454:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789128977.675472:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789128977.678151:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789128977.678167:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789128977.678976:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789128977.678983:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789128977.687092:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789128977.687445:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789128977.687453:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789128977.688356:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789128977.688365:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789128977.783398:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789128977.783920:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789128977.783927:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789128977.785945:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789128977.785957:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789128977.797284:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789128977.797485:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789128977.797493:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789128977.798428:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789128977.798437:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789128977.803215:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789128977.803458:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789128977.803465:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789128977.804532:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789128977.804541:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789128977.807075:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789128977.808262:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789128977.808273:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789128977.810238:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789128977.810252:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789128977.880893:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789128977.881204:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789128977.881212:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789128977.884827:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789128977.884843:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789128977.893142:0:5820:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789128977.893159:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789128977.896906:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789128977.897004:0:5820:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789128977.897013:0:5820:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789128977.897246:0:5820:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789128977.897286:0:5820:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.139@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789128977.897291:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789128977.897293:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789128977.897294:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789128977.897295:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789128977.897297:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789128977.897298:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789128977.897299:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789128977.897301:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789128977.897302:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789128977.897303:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789128977.897305:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789128977.897307:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789128977.897309:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789128977.897311:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789128977.897312:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789128977.897313:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789128977.897314:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789128977.897315:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789128977.897316:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789128977.897317:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789128977.897318:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789128977.897319:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789128977.897320:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789128977.897321:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789128977.897322:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789128977.897360:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789128977.897377:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c6ae0481 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495232:0@lo:253: 00000100:00100000:1.0:1789128977.897462:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128977.897633:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000954d17b1 going to sleep for 11 seconds 00000100:00100000:0.0:1789128977.897833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626495232 00000100:00100000:0.0:1789128977.897842:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626495232 00000100:00100000:0.0:1789128977.898005:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789128977.898016:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cae9188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:5820:x1876037626495232:12345-0@lo:253: 20000000:01000000:0.0:1789128977.898071:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789128977.898074:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789128977.898511:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789128977.898687:0:5835:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789128977.898993:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789128977.900419:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789128977.900970:0:5835:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789128977.900976:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789128977.900982:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789128977.900985:0:5835:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789128977.901003:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789128977.902048:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789128977.902375:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789128977.902397:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789128977.902456:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789128977.902591:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789128977.902772:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789128977.904310:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789128977.904329:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789128977.904406:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789128977.904415:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789128977.904450:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789128977.904458:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789128977.904490:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789128977.905351:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789128977.905423:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789128977.905431:0:5835:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789128977.905445:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789128977.906734:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789128977.906759:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789128977.906818:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789128977.906854:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789128977.906901:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789128977.906915:0:5835:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789128977.907859:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789128977.907873:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789128977.907950:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789128977.907986:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789128977.908019:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789128977.908032:0:5835:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789128977.912945:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789128977.912979:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789128977.913076:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789128977.913725:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789128977.913991:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789128977.914042:0:5835:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789128977.914050:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789128977.919406:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789128977.920055:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789128977.920083:0:5835:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.139@tcp for mdt 20000000:01000000:1.0:1789128977.920086:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.139@tcp (null) (null) (null) 00000040:00080000:1.0:1789128977.920206:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789128977.920215:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789128977.920248:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789128977.920255:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.139@tcp (null) (null) 00000040:00080000:1.0:1789128977.920297:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789128977.920308:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789128977.920424:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789128977.920457:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789128977.920592:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789128977.920596:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789128977.920842:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789128977.920869:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789128977.920872:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789128977.920903:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789128977.920905:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789128977.921306:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789128977.922113:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789128977.922253:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789128977.924010:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789128977.924044:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789128977.924060:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789128977.926554:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789128977.927110:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789128977.927186:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789128977.927272:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1789128977.927301:0:5835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789128977.927304:0:5835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789128977.927309:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789128977.927312:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789128977.927322:0:5835:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789128977.927329:0:5835:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789128977.929538:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1789128977.929963:0:5835:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789128977.937576:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1789128977.937964:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1789128977.938089:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1789128977.938112:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789128977.938145:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128977.938163:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128977.938182:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128977.938188:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128977.938193:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128977.938199:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128977.938206:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e1399463 already unused, calling callback (00000000d9dfde41) 00010000:00010000:3.0:1789128977.938210:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128977.938217:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128977.938229:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128977.938236:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128977.938251:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e1399463/0x5c74554e47ce3f96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789128977.938271:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789128978.198512:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cae9188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:5820:x1876037626495232:12345-0@lo:253: Request processed in 300489us (301041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128978.198534:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789128978.198819:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c6ae0481 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495232:0@lo:253: 10000000:01000000:3.0:1789128978.198838:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789128978.198841:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789128978.198843:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789128978.198844:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789128978.198845:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789128978.198846:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789128978.198848:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789128978.198849:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789128978.198850:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789128978.198851:0:5820:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789128978.198853:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789128978.198854:0:5820:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789128978.198878:0:5820:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003a8dadc8 from lustre-MDT0000 10000000:01000000:3.0:1789128978.198905:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789128978.198908:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789128978.198913:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90b487c73490 10000000:01000000:3.0:1789128978.198917:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789128978.198925:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90b487c73490 from 1 10000000:01000000:3.0:1789128978.198928:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789128978.198969:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 00000000e1399463/0x5c74554e47ce3f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.198979:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 00000000e1399463/0x5c74554e47ce3f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.198987:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 00000000e1399463/0x5c74554e47ce3f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128978.199021:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495360:0@lo:101: 00000100:00100000:3.0:1789128978.199081:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128978.199215:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3ef8b75 going to sleep for 11 seconds 00000100:00100000:0.0:1789128978.199324:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626495360 00000100:00100000:0.0:1789128978.199496:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626495360 00000100:00100000:0.0:1789128978.199545:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789128978.199553:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c571f5d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:5820:x1876037626495360:12345-0@lo:101: 00010000:00010000:0.0:1789128978.199577:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789128978.199590:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac03131b/0x5c74554e47ce3fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce3f9d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.199996:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac03131b/0x5c74554e47ce3fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce3f9d expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.200008:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac03131b/0x5c74554e47ce3fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce3f9d expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.200016:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac03131b, rc 0) 00000100:00100000:0.0:1789128978.200415:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c571f5d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+6:5820:x1876037626495360:12345-0@lo:101: Request processed in 861us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128978.200423:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789128978.200560:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495360:0@lo:101: 00010000:00010000:3.0:1789128978.200577:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 00000000e1399463/0x5c74554e47ce3f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.200587:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 00000000e1399463/0x5c74554e47ce3f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128978.200898:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495488:0@lo:501: 00000100:00100000:3.0:1789128978.200934:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128978.201256:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3ef8b75 going to sleep for 11 seconds 00000100:00100000:2.0:1789128978.201303:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626495488 00000100:00100000:2.0:1789128978.201310:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626495488 00000100:00100000:2.0:1789128978.201569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789128978.201578:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d6fe9a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+6:5820:x1876037626495488:12345-0@lo:501: 00000100:00100000:2.0:1789128978.202381:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d6fe9a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+6:5820:x1876037626495488:12345-0@lo:501: Request processed in 801us (1442us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789128978.202393:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789128978.202500:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495488:0@lo:501: 10000000:01000000:3.0:1789128978.202534:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789128978.202555:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 00000000e1399463/0x5c74554e47ce3f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.202566:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 00000000e1399463/0x5c74554e47ce3f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789128978.202576:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b4921dd800 10000000:01000000:3.0:1789128978.202581:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789128978.202586:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90b4921dd800 10000000:01000000:3.0:1789128978.202589:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789128978.202592:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90b4921dd800 from 1 10000000:01000000:3.0:1789128978.202820:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789128978.202851:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 00000000a3637bbc/0x5c74554e47ce3fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.202859:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 00000000a3637bbc/0x5c74554e47ce3fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.202867:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 00000000a3637bbc/0x5c74554e47ce3fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128978.202883:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495616:0@lo:101: 00000100:00100000:3.0:1789128978.202916:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128978.202948:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3ef8b75 going to sleep for 11 seconds 00000100:00100000:0.0:1789128978.203005:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626495616 00000100:00100000:0.0:1789128978.203012:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626495616 00000100:00100000:0.0:1789128978.203050:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789128978.203057:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7c8fe8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+6:5820:x1876037626495616:12345-0@lo:101: 00010000:00010000:0.0:1789128978.203068:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789128978.203080:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a95235f6/0x5c74554e47ce3fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce3fab expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.203100:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a95235f6/0x5c74554e47ce3fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce3fab expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.203110:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a95235f6/0x5c74554e47ce3fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce3fab expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.203250:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a95235f6, rc 0) 00000100:00100000:0.0:1789128978.203299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7c8fe8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+7:5820:x1876037626495616:12345-0@lo:101: Request processed in 242us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128978.203306:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789128978.203782:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495616:0@lo:101: 00010000:00010000:3.0:1789128978.203797:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 00000000a3637bbc/0x5c74554e47ce3fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.203805:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 00000000a3637bbc/0x5c74554e47ce3fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789128978.203823:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789128978.203842:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 00000000a3637bbc/0x5c74554e47ce3fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.203849:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 00000000a3637bbc/0x5c74554e47ce3fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789128978.203855:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789128978.203859:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789128978.203863:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90b4921dd800 10000000:01000000:3.0:1789128978.203873:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789128978.203876:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789128978.203878:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789128978.203897:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 000000003db36463/0x5c74554e47ce3fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.203903:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 000000003db36463/0x5c74554e47ce3fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.203909:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 000000003db36463/0x5c74554e47ce3fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128978.203922:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495744:0@lo:101: 00000100:00100000:3.0:1789128978.203953:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128978.204026:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3ef8b75 going to sleep for 11 seconds 00000100:00100000:2.0:1789128978.206571:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626495744 00000100:00100000:2.0:1789128978.206590:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626495744 00000100:00100000:2.0:1789128978.206828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789128978.206838:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f64e3321 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+7:5820:x1876037626495744:12345-0@lo:101: 00010000:00010000:2.0:1789128978.206855:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789128978.206874:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ebb452a9/0x5c74554e47ce3fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce3fb9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128978.206906:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ebb452a9/0x5c74554e47ce3fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce3fb9 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128978.206918:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ebb452a9/0x5c74554e47ce3fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce3fb9 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128978.206928:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ebb452a9, rc 0) 00000100:00100000:2.0:1789128978.207013:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f64e3321 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+8:5820:x1876037626495744:12345-0@lo:101: Request processed in 177us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128978.207020:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789128978.207173:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495744:0@lo:101: 00010000:00010000:3.0:1789128978.207191:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 000000003db36463/0x5c74554e47ce3fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.207201:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 000000003db36463/0x5c74554e47ce3fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128978.207271:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495872:0@lo:501: 00000100:00100000:3.0:1789128978.207306:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128978.207339:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3ef8b75 going to sleep for 11 seconds 00000100:00100000:2.0:1789128978.209321:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626495872 00000100:00100000:2.0:1789128978.209336:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626495872 00000100:00100000:2.0:1789128978.209387:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789128978.209395:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000004dcd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+8:5820:x1876037626495872:12345-0@lo:501: 00000100:00100000:3.0:1789128978.212584:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000004dcd46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:5820:x1876037626495872:12345-0@lo:501: Request processed in 3179us (5266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128978.212770:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789128978.213773:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626495872:0@lo:501: 00000100:00100000:2.0:1789128978.213836:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcbf6549 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496000:0@lo:503: 00000100:00100000:2.0:1789128978.213916:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789128978.213977:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001c82f02 going to sleep for 11 seconds 00000100:00100000:0.0:1789128978.214049:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626496000 00000100:00100000:0.0:1789128978.214056:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626496000 00000100:00100000:0.0:1789128978.214105:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789128978.214125:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d82ab1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:5820:x1876037626496000:12345-0@lo:503: 00000100:00100000:0.0:1789128978.214352:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d82ab1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:5820:x1876037626496000:12345-0@lo:503: Request processed in 239us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128978.214360:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789128978.214521:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcbf6549 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496000:0@lo:503: 00000100:00100000:3.0:1789128978.225641:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000750aee3f pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5863:1876037626496128:0@lo:502: 00000100:00100000:3.0:1789128978.225743:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128978.225811:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 000000005a89e164 going to sleep for 11 seconds 00000100:00100000:1.0:1789128978.226002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626496128 00000100:00100000:1.0:1789128978.226009:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626496128 00000100:00100000:1.0:1789128978.226053:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789128978.226060:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e1d929f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:5863:x1876037626496128:12345-0@lo:502: 00000100:00100000:1.0:1789128978.226329:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e1d929f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:5863:x1876037626496128:12345-0@lo:502: Request processed in 269us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789128978.226337:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789128978.226892:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000750aee3f pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5863:1876037626496128:0@lo:502: 00000020:01000000:3.0:1789128978.226922:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789128978.226932:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789128978.226935:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789128978.226941:0:5863:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789128978.226944:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789128978.226956:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e173b79b) 00000020:00000080:3.0:1789128978.226972:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789128978.226977:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789128978.227053:0:5863:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789128978.227071:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce3fce 00000020:00000080:3.0:1789128978.227592:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789128978.227597:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789128978.227706:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789128978.227709:0:5863:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789128978.227713:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789128978.227718:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789128978.227719:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789128978.227722:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789128978.227730:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000518ee2f1) 00000020:00000080:3.0:1789128978.227742:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789128978.227746:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789128978.227748:0:5863:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789128978.227751:0:5863:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789128978.227757:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789128978.227808:0:5863:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003a8dadc8 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789128978.227825:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000bfed44b9) 00000020:00000080:3.0:1789128978.227832:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789128978.227881:0:5863:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789128978.227891:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce3fe3 00000020:00000080:3.0:1789128978.227998:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789128978.228004:0:5863:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789128978.228008:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5c74554e47ce3fea 00080000:01000000:3.0:1789128978.228014:0:5863:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789128978.228018:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce3ff1 00080000:10000000:2.0:1789128978.232490:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789128978.232914:0:5863:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789128978.237873:0:5863:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789128978.369396:0:5863:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789128978.369816:0:5863:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789128978.375490:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789128978.375986:0:5863:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789128978.418785:0:5863:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ff2620cd) 00000020:00000080:3.0:1789128978.418818:0:5863:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789128978.418887:0:5863:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789128978.418893:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce3fff 00000020:00000080:3.0:1789128978.430665:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789128978.432009:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789128978.545459:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:3.0:1789128978.575541:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789128978.638752:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789128978.747690:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789128978.815901:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789128978.871791:0:5863:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789128978.924414:0:5863:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5c74554e47ce4006 00000020:00000080:1.0:1789128978.925678:0:5863:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789128978.925691:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789128978.925697:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789128978.925699:0:5863:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789128978.925702:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789128978.925706:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789128978.925707:0:5863:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789128978.925710:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789128978.925711:0:5863:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789128978.925715:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789128978.925717:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789128978.925718:0:5863:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789128978.925720:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789128978.925725:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789128978.925726:0:5863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789128978.925731:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789128978.925770:0:5863:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789128978.925827:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003746e01a pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5863:1876037626496256:0@lo:502: 00000100:00100000:1.0:1789128978.925905:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128978.925964:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 00000000954d17b1 going to sleep for 11 seconds 00000100:00100000:2.0:1789128978.926030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626496256 00000100:00100000:2.0:1789128978.926038:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626496256 00000100:00100000:2.0:1789128978.926086:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789128978.926095:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030740c1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:5863:x1876037626496256:12345-0@lo:502: 00000100:00100000:2.0:1789128978.926457:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030740c1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:5863:x1876037626496256:12345-0@lo:502: Request processed in 363us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128978.926465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789128978.926514:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003746e01a pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5863:1876037626496256:0@lo:502: 00000020:01000000:2.0:1789128978.926540:0:5863:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789128978.926545:0:5863:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789128978.926546:0:5863:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789128978.926550:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789128978.926684:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789128978.926700:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789128978.926717:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 000000003db36463/0x5c74554e47ce3fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128978.926727:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 000000003db36463/0x5c74554e47ce3fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789128978.926736:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b4921dd800 from 1 10000000:01000000:2.0:1789128978.926739:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789128978.926774:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128978.926781:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128978.926788:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789128978.926800:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcbf6549 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496384:0@lo:101: 00000100:00100000:2.0:1789128978.926828:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789128978.926848:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000647ce59b going to sleep for 11 seconds 00000100:00100000:0.0:1789128978.927288:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626496384 00000100:00100000:0.0:1789128978.927295:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626496384 00000100:00100000:0.0:1789128978.927333:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789128978.927342:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f81d1fcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:5820:x1876037626496384:12345-0@lo:101: 00010000:00010000:0.0:1789128978.927352:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789128978.927367:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b7de42cf/0x5c74554e47ce4014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce400d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.927390:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b7de42cf/0x5c74554e47ce4014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce400d expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.927400:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b7de42cf/0x5c74554e47ce4014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce400d expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.927419:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b7de42cf, rc 0) 00000100:00100000:0.0:1789128978.927453:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f81d1fcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:5820:x1876037626496384:12345-0@lo:101: Request processed in 112us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128978.927459:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789128978.927582:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcbf6549 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496384:0@lo:101: 00010000:00010000:2.0:1789128978.927595:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128978.927642:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789128978.928245:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcbf6549 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496512:0@lo:256: 00000100:00100000:2.0:1789128978.928285:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789128978.928369:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000647ce59b going to sleep for 11 seconds 00000100:00100000:1.0:1789128978.928590:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626496512 00000100:00100000:1.0:1789128978.928597:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626496512 00000100:00100000:1.0:1789128978.928702:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789128978.928709:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a3f1d5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:5820:x1876037626496512:12345-0@lo:256: 20000000:01000000:1.0:1789128978.928727:0:5834:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789128978.928733:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789128978.928951:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a3f1d5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:5820:x1876037626496512:12345-0@lo:256: Request processed in 243us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789128978.928959:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789128978.929041:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcbf6549 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496512:0@lo:256: 10000000:01000000:3.0:1789128978.931390:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789128978.931422:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.931436:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789128978.931446:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4921dd800 from 1 10000000:01000000:3.0:1789128978.931449:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789128978.931492:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.931500:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.931521:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128978.931544:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000750aee3f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496640:0@lo:101: 00000100:00100000:3.0:1789128978.931925:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128978.932013:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4e5e219 going to sleep for 11 seconds 00000100:00100000:2.0:1789128978.936019:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626496640 00000100:00100000:2.0:1789128978.936035:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626496640 00000100:00100000:2.0:1789128978.936648:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789128978.936661:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002914a71f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:5820:x1876037626496640:12345-0@lo:101: 00010000:00010000:2.0:1789128978.936682:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789128978.936702:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c0722c4b/0x5c74554e47ce4022 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce401b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128978.936751:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c0722c4b/0x5c74554e47ce4022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce401b expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128978.936762:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c0722c4b/0x5c74554e47ce4022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce401b expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128978.936770:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c0722c4b, rc 0) 00000100:00100000:2.0:1789128978.936855:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002914a71f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:5820:x1876037626496640:12345-0@lo:101: Request processed in 198us (4931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128978.936862:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789128978.936952:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000750aee3f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496640:0@lo:101: 00010000:00010000:3.0:1789128978.936970:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128978.936978:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128978.937043:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000750aee3f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496768:0@lo:501: 00000100:00100000:3.0:1789128978.937075:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128978.937286:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4e5e219 going to sleep for 11 seconds 00000100:00100000:1.0:1789128978.937357:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626496768 00000100:00100000:1.0:1789128978.937363:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626496768 00000100:00100000:1.0:1789128978.937388:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789128978.937395:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae8f9133 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:5820:x1876037626496768:12345-0@lo:501: 00000100:00100000:1.0:1789128978.938006:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae8f9133 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:5820:x1876037626496768:12345-0@lo:501: Request processed in 611us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789128978.938015:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789128978.938593:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000750aee3f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496768:0@lo:501: 00000100:00100000:3.0:1789128978.938673:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000750aee3f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496896:0@lo:503: 00000100:00100000:3.0:1789128978.938728:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128978.938757:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4e5e219 going to sleep for 11 seconds 00000100:00100000:1.0:1789128978.938889:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626496896 00000100:00100000:1.0:1789128978.938895:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626496896 00000100:00100000:1.0:1789128978.938935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789128978.938943:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001076fa56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:5820:x1876037626496896:12345-0@lo:503: 00000040:00080000:1.0:1789128978.938985:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789128978.939021:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001076fa56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:5820:x1876037626496896:12345-0@lo:503: Request processed in 79us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789128978.939027:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789128978.939572:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000750aee3f pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626496896:0@lo:503: 00000040:00080000:2.0:1789128978.940773:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789128978.940954:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789128978.940973:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789128978.941025:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789128978.941037:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789128978.941095:0:5820:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789128978.941177:0:5820:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b4921dd800 10000000:01000000:1.0:1789128978.941181:0:5820:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b4921dd800 10000000:01000000:1.0:1789128978.941186:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789128978.941192:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b4921dd800 from 1 10000000:01000000:1.0:1789128978.941195:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789128978.941232:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 00000000ddb44c34/0x5c74554e47ce4029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789128978.941240:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 00000000ddb44c34/0x5c74554e47ce4029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789128978.941248:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 00000000ddb44c34/0x5c74554e47ce4029 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789128978.941267:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d04d644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626497024:0@lo:101: 00000100:00100000:1.0:1789128978.941327:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128978.941372:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000007838e7bf going to sleep for 11 seconds 00000100:00100000:0.0:1789128978.941749:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626497024 00000100:00100000:0.0:1789128978.941757:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626497024 00000100:00100000:0.0:1789128978.941803:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789128978.941811:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd2f0418 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:5820:x1876037626497024:12345-0@lo:101: 00010000:00010000:0.0:1789128978.941824:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789128978.941838:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df2bcad4/0x5c74554e47ce4030 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4029 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.941860:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df2bcad4/0x5c74554e47ce4030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4029 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.941870:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df2bcad4/0x5c74554e47ce4030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4029 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.941879:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df2bcad4, rc 0) 00000100:00100000:0.0:1789128978.942003:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd2f0418 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5820:x1876037626497024:12345-0@lo:101: Request processed in 193us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128978.942011:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789128978.942390:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d04d644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626497024:0@lo:101: 00010000:00010000:1.0:1789128978.942410:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 00000000ddb44c34/0x5c74554e47ce4029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789128978.942419:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 00000000ddb44c34/0x5c74554e47ce4029 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789128978.942480:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d04d644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626497152:0@lo:501: 00000100:00100000:1.0:1789128978.942512:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128978.942597:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 000000007838e7bf going to sleep for 11 seconds 00000100:00100000:3.0:1789128978.942743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626497152 00000100:00100000:3.0:1789128978.942751:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626497152 00000100:00100000:3.0:1789128978.942788:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789128978.942795:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000998f0452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5820:x1876037626497152:12345-0@lo:501: 00000100:00100000:3.0:1789128978.943083:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000998f0452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5820:x1876037626497152:12345-0@lo:501: Request processed in 288us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128978.943091:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789128978.943226:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d04d644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626497152:0@lo:501: 00000100:00100000:0.0:1789128978.943264:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb9d868a pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626497280:0@lo:503: 00000100:00100000:0.0:1789128978.943305:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789128978.943327:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000079ebdfa going to sleep for 11 seconds 00000100:00100000:0.0:1789128978.943348:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626497280 00000100:00100000:0.0:1789128978.943351:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626497280 00000100:00100000:0.0:1789128978.943370:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789128978.943374:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057beed73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5820:x1876037626497280:12345-0@lo:503: 00000100:00100000:0.0:1789128978.943745:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057beed73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5820:x1876037626497280:12345-0@lo:503: Request processed in 369us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128978.943752:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789128978.943796:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb9d868a pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626497280:0@lo:503: 00000100:00100000:3.0:1789128978.944657:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000750aee3f pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5868:1876037626497408:0@lo:502: 00000100:00100000:3.0:1789128978.944704:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128978.944737:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 00000000397b6d61 going to sleep for 11 seconds 00000100:00100000:0.0:1789128978.944819:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626497408 00000100:00100000:0.0:1789128978.944824:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626497408 00000100:00100000:0.0:1789128978.944859:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789128978.944865:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014534799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5868:x1876037626497408:12345-0@lo:502: 00000100:00100000:2.0:1789128978.945196:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000750aee3f pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5868:1876037626497408:0@lo:502: 00000020:01000004:2.0:1789128978.945252:0:5868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789128978.945270:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003e39e4b0) 00000020:00000080:2.0:1789128978.945294:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789128978.945368:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003a8dadc8 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789128978.945372:0:5868:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003a8dadc8 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789128978.945374:0:5868:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003a8dadc8 4 00010000:00080000:2.0:1789128978.945403:0:5868:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005e781af5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.139@tcp at head 00000100:00100000:0.0:1789128978.946277:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014534799 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5868:x1876037626497408:12345-0@lo:502: Request processed in 231us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128978.946292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789128978.948548:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789128978.948845:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789128978.948880:0:5868:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789128978.948965:0:5868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5c74554e47ce403e 00000100:00080000:2.0:1789128978.948976:0:5868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789128978.948982:0:5868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005e781af5 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1789128978.949018:0:5868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000021bab533 x1876037626497536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789128978.949056:0:5868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789128978.949847:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000021bab533 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626497536:0@lo:38: 00000100:00100000:0.0:1789128978.949929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789128978.950093:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626497536 00000100:00100000:2.0:1789128978.950174:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626497536 00000100:00100000:2.0:1789128978.950216:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789128978.950222:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb9d868a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876037626497536:12345-0@lo:38: 00000100:00100000:2.0:1789128978.950287:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb9d868a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876037626497536:12345-0@lo:38: Request processed in 64us (358us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789128978.950295:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789128978.950388:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789128978.950397:0:3305:0:(import.c:65:import_set_state_nolock()) 000000005e781af5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789128978.950401:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789128978.950404:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000021bab533 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626497536:0@lo:38: 00000100:00100000:0.0:1789128978.951557:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2720770 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5868:1876037626497664:0@lo:502: 00000100:00100000:0.0:1789128978.951658:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789128978.951690:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 000000007e9a4c65 going to sleep for 11 seconds 00000100:00100000:1.0:1789128978.951752:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626497664 00000100:00100000:1.0:1789128978.951758:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626497664 00000100:00100000:1.0:1789128978.951801:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789128978.951809:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000caa6fa6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5868:x1876037626497664:12345-0@lo:502: 00000100:00100000:1.0:1789128978.952058:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000caa6fa6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5868:x1876037626497664:12345-0@lo:502: Request processed in 250us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789128978.952066:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789128978.952261:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2720770 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5868:1876037626497664:0@lo:502: 00000040:00080000:1.0:1789128978.952287:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789128978.952441:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789128978.952459:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789128978.952487:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 00000000ddb44c34/0x5c74554e47ce4029 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128978.952497:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 00000000ddb44c34/0x5c74554e47ce4029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789128978.952544:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789128978.952547:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789128978.952548:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789128978.952550:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789128978.952551:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789128978.952552:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789128978.952553:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789128978.952554:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789128978.952556:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789128978.952557:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789128978.952559:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789128978.952560:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789128978.952564:0:5820:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789128978.952566:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789128978.952568:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789128978.952569:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789128978.952570:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789128978.952571:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789128978.952573:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789128978.952574:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789128978.952575:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789128978.952576:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789128978.952576:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789128978.952577:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789128978.952579:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789128978.952625:0:5820:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789128978.952637:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa48627a pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626497792:0@lo:253: 00000100:00100000:0.0:1789128978.952682:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789128978.952716:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set 00000000129e85f2 going to sleep for 11 seconds 00000100:00100000:0.0:1789128978.953562:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626497792 00000100:00100000:0.0:1789128978.953572:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626497792 00000100:00100000:0.0:1789128978.953716:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789128978.953725:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffbcbe17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5820:x1876037626497792:12345-0@lo:253: 20000000:01000000:0.0:1789128978.953754:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789128978.953768:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789128979.012432:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789128979.012454:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789128979.012515:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789128979.012521:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789128979.012542:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128979.012560:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b7de42cf/0x5c74554e47ce4014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce400d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128979.012567:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128979.012631:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b7de42cf/0x5c74554e47ce4014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce400d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128979.012647:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b7de42cf/0x5c74554e47ce4014 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce400d expref: 12 pid: 5834 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128979.012661:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000722bff33 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876037626497920:0@lo:104: 00000100:00100000:3.0:1789128979.012733:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128979.012792:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f3afef82 going to sleep for 11 seconds 00000100:00100000:0.0:1789128979.014871:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626497920 00000100:00100000:0.0:1789128979.014884:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626497920 00000100:00100000:0.0:1789128979.014934:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789128979.014943:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c921f07f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:5856:x1876037626497920:12345-0@lo:104: 00010000:00010000:0.0:1789128979.014959:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128979.015039:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789128979.015045:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c921f07f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:5856:x1876037626497920:12345-0@lo:104: Request processed in 104us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128979.015051:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789128979.017618:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789128979.017630:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.017643:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002976e7fc already unused, calling callback (00000000e4b1e2fa) 10000000:00010000:2.0:1789128979.017647:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.017657:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789128979.017664:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789128979.017671:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789128979.017767:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.017775:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789128979.017795:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.017819:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: 000000002976e7fc/0x5c74554e47ce400d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4014 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.017837:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789128979.017839:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789128979.017840:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789128979.017876:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000722bff33 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876037626497920:0@lo:104: 00010000:00010000:2.0:1789128979.017898:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128979.018032:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f8d4c54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626498048:0@lo:103: 00000100:00100000:3.0:1789128979.018168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789128979.018718:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626498048 00000100:00100000:2.0:1789128979.018726:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626498048 00010000:00010000:2.0:1789128979.018752:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b7de42cf/0x5c74554e47ce4014 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce400d expref: 13 pid: 5834 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789128979.018782:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789128979.018791:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003511869d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:3307:x1876037626498048:12345-0@lo:103: 00010000:00010000:2.0:1789128979.018804:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789128979.018809:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b7de42cf/0x5c74554e47ce4014 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce400d expref: 13 pid: 5834 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018819:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b7de42cf/0x5c74554e47ce4014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce400d expref: 13 pid: 5834 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018834:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b7de42cf/0x5c74554e47ce4014 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce400d expref: 13 pid: 5834 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018847:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018862:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789128979.018876:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006356198s 00010000:00010000:2.0:1789128979.018880:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018886:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018892:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018898:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018903:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cbae306f already unused, calling callback (00000000d9dfde41) 00010000:00010000:2.0:1789128979.018906:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018913:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018926:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.018936:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789128979.018975:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003511869d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:3307:x1876037626498048:12345-0@lo:103: Request processed in 186us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128979.018983:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789128979.019010:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.019017:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128979.019023:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cbae306f/0x5c74554e47ce4045 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128979.019186:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f8d4c54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626498048:0@lo:103: 00000100:00100000:2.0:1789128979.033972:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffbcbe17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:5820:x1876037626497792:12345-0@lo:253: Request processed in 80241us (81282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128979.033990:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789128979.034121:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa48627a pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5820:1876037626497792:0@lo:253: 10000000:01000000:0.0:1789128979.034139:0:5820:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789128979.034142:0:5820:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789128979.034143:0:5820:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789128979.034154:0:5820:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789128979.034156:0:5820:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789128979.034157:0:5820:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789128979.034158:0:5820:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789128979.034160:0:5820:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789128979.034161:0:5820:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789128979.034163:0:5820:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789128979.034164:0:5820:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789128979.034166:0:5820:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789128979.034167:0:5820:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789128979.034188:0:5820:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789128979.045624:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789128979.046728:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789128979.047018:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789128979.047437:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789128979.047681:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789128979.047858:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789128979.048590:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789128979.048870:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789128979.049080:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789128979.049334:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789128979.049542:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789128979.049764:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789128979.097575:0:5820:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789128979.154352:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789128979.154730:0:5874:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1789128979.157046:0:5873:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1789128979.157053:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789128979.160179:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789128979.160364:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789128979.160813:0:5820:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789128979.160821:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789128979.160970:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789128979.164017:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789128979.165005:0:5820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789128979.165063:0:5820:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789128979.166982:0:5820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789128979.167343:0:5820:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1789128979.172029:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789128979.172452:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1789128979.172584:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789128979.177374:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1789128979.177679:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789128979.177840:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789128979.178001:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789128979.178491:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789128979.178667:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789128979.178826:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789128979.178977:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789128979.180257:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789128979.180448:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789128979.180835:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789128979.181029:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789128979.182000:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789128979.182539:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789128979.183273:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789128979.183429:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789128979.183575:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789128979.184443:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789128979.184630:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789128979.184814:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789128979.190862:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789128979.191263:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789128979.191408:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789128979.191548:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789128979.191736:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789128979.191876:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789128979.197369:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789128979.197942:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789128979.198130:0:5820:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789128979.198363:0:5820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789128979.232942:0:5874:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789128979.421925:0:5820:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789128979.421965:0:5820:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb11201987988 00100000:10000000:3.0:1789128979.421974:0:5820:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:1.0:1789128979.427021:0:5874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789128979.427123:0:5874:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789128979.427129:0:5874:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:2.0:1789128979.427858:0:5820:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789128979.427877:0:5820:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789128979.427890:0:5820:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789128979.427921:0:5820:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789128979.590002:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789128980.615657:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128981.637838:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128982.661949:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128983.686859:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789128984.326649:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789128984.326662:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789128984.326666:0:38:0:(import.c:65:import_set_state_nolock()) 000000005e781af5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789128984.326682:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000005e781af5 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1789128984.326710:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b0d8f036 x1876037626498304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789128984.326750:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0d8f036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626498304:0@lo:38: 00000100:00100000:2.0:1789128984.326830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789128984.326923:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626498304 00000100:00100000:2.0:1789128984.326930:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626498304 00000100:00100000:2.0:1789128984.326963:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789128984.326970:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a0b7c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876037626498304:12345-0@lo:38: 00010000:00080000:2.0:1789128984.326996:0:5842:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:2.0:1789128984.327031:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5c74554e47ce404c 00000004:00100000:2.0:1789128984.327086:0:5842:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789128984.327215:0:5842:0:(import.c:65:import_set_state_nolock()) 0000000013bc239f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789128984.327268:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a0b7c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876037626498304:12345-0@lo:38: Request processed in 297us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128984.327276:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789128984.327316:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b0d8f036 x1876037626498304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789128994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789128984.327330:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789128984.327336:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789128984.327340:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789128984.327342:0:3305:0:(import.c:65:import_set_state_nolock()) 000000005e781af5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789128984.327347:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0d8f036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626498304:0@lo:38: 00000100:00100000:1.0:1789128984.327567:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dcbf6549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626498176:0@lo:400: 00000100:00100000:1.0:1789128984.327640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789128984.328172:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626498176 00000100:00100000:2.0:1789128984.328179:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626498176 00000100:00100000:2.0:1789128984.328225:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789128984.328233:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b02241c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:3308:x1876037626498176:12345-0@lo:400: 00000100:00100000:2.0:1789128984.328279:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b02241c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:3308:x1876037626498176:12345-0@lo:400: Request processed in 48us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128984.328284:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789128984.330252:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dcbf6549 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626498176:0@lo:400: 00010000:00010000:3.0:1789128984.722978:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789128985.498201:0:6117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789128985.735194:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128986.760213:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128987.789123:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789128987.909949:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789128987.909960:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b4921dd800 from 3 10000000:01000000:1.0:1789128987.909966:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789128987.910047:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 00000000137eada6/0x5c74554e47ce4053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789128987.910062:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 00000000137eada6/0x5c74554e47ce4053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789128987.910074:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 00000000137eada6/0x5c74554e47ce4053 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789128987.910104:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8425a98 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626498432:0@lo:101: 00000100:00100000:1.0:1789128987.910197:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128987.910272:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000000502133e going to sleep for 11 seconds 00000100:00100000:2.0:1789128987.910349:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626498432 00000100:00100000:2.0:1789128987.910374:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626498432 00000100:00100000:2.0:1789128987.910435:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789128987.910444:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5ac2d4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:5837:x1876037626498432:12345-0@lo:101: 00010000:00010000:2.0:1789128987.910478:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789128987.910491:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000961c8938/0x5c74554e47ce405a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4053 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128987.910517:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000961c8938/0x5c74554e47ce405a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4053 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128987.910529:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000961c8938/0x5c74554e47ce405a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4053 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128987.910540:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000961c8938, rc 0) 00000100:00100000:2.0:1789128987.910589:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5ac2d4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5837:x1876037626498432:12345-0@lo:101: Request processed in 146us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128987.910627:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789128987.911226:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8425a98 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626498432:0@lo:101: 00010000:00010000:1.0:1789128987.911248:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 00000000137eada6/0x5c74554e47ce4053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789128987.911257:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 00000000137eada6/0x5c74554e47ce4053 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789128987.911332:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8425a98 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626498560:0@lo:256: 00000100:00100000:1.0:1789128987.911375:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128987.911414:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000000502133e going to sleep for 11 seconds 00000100:00100000:2.0:1789128987.911705:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626498560 00000100:00100000:2.0:1789128987.911710:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626498560 00000100:00100000:2.0:1789128987.911749:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789128987.911756:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001698d17c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5837:x1876037626498560:12345-0@lo:256: 20000000:01000000:2.0:1789128987.911780:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789128987.911801:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789128987.911805:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789128987.911882:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001698d17c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5837:x1876037626498560:12345-0@lo:256: Request processed in 128us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128987.911888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789128987.911949:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8425a98 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626498560:0@lo:256: 10000000:01000000:1.0:1789128987.912004:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789128987.912011:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: 00000000137eada6/0x5c74554e47ce4053 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789128987.912020:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: 00000000137eada6/0x5c74554e47ce4053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128988.806286:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789128989.449392:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d04d644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626498816:0@lo:400: 00000100:00100000:1.0:1789128989.449524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128989.449658:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626498816 00000100:00100000:1.0:1789128989.449666:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626498816 00000100:00100000:1.0:1789128989.449709:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789128989.449717:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003746e01a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626498816:12345-0@lo:400: 00000100:00100000:1.0:1789128989.449767:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003746e01a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626498816:12345-0@lo:400: Request processed in 51us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789128989.449776:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789128989.449811:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000d04d644 x1876037626498816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789128989.449825:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d04d644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626498816:0@lo:400: 00000100:00100000:3.0:1789128989.449911:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789128989.449921:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a9cb570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626498688:0@lo:400: 00000100:00100000:3.0:1789128989.449954:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128989.450357:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626498688 00000100:00100000:1.0:1789128989.450362:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626498688 00000100:00100000:1.0:1789128989.450398:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789128989.450406:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004df01f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:3308:x1876037626498688:12345-0@lo:400: 00000100:00100000:1.0:1789128989.450445:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004df01f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:3308:x1876037626498688:12345-0@lo:400: Request processed in 41us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789128989.450452:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789128989.450498:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a9cb570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626498688:0@lo:400: 00010000:00010000:3.0:1789128989.830052:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789128990.628918:0:6319:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb8e6e760 20000000:00000080:3.0:1789128990.628959:0:6319:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b485d36000 uarg=0000000000000000 20000000:01000000:3.0:1789128990.629009:0:6319:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789128990.629018:0:6319:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789128990.629026:0:6319:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789128990.630160:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789128990.630185:0:6319:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789128990.649115:0:6319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789128990.649436:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789128990.649502:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789128990.649550:0:6319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789128990.655217:0:6319:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789128990.655245:0:6319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.655265:0:6319:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c0722c4b/0x5c74554e47ce4022 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce401b expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.655272:0:6319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.655312:0:6319:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c0722c4b/0x5c74554e47ce4022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce401b expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.655326:0:6319:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c0722c4b/0x5c74554e47ce4022 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce401b expref: 11 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128990.655340:0:6319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d09b73e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1876037626498944:0@lo:104: 00000100:00100000:3.0:1789128990.655406:0:6319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128990.655466:0:6319:0:(client.c:2715:ptlrpc_set_wait()) set 0000000014cae382 going to sleep for 11 seconds 00000100:00100000:0.0:1789128990.657470:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626498944 00000100:00100000:0.0:1789128990.657495:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626498944 00000100:00100000:0.0:1789128990.657577:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789128990.657590:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000722bff33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:6319:x1876037626498944:12345-0@lo:104: 00010000:00010000:0.0:1789128990.657766:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128990.657953:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789128990.657960:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000722bff33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:6319:x1876037626498944:12345-0@lo:104: Request processed in 373us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128990.657970:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789128990.658834:0:6319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d09b73e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6319:1876037626498944:0@lo:104: 00010000:00010000:3.0:1789128990.658881:0:6319:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128990.659952:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789128990.659967:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128990.659999:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000035e4eb03 already unused, calling callback (00000000e4b1e2fa) 10000000:00010000:2.0:1789128990.660003:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128990.660014:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789128990.660021:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789128990.660027:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789128990.660114:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128990.660122:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789128990.660153:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128990.660161:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: 0000000035e4eb03/0x5c74554e47ce401b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4022 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128990.660195:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789128990.660198:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789128990.660200:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789128990.660238:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789128990.660267:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0979d21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626499072:0@lo:103: 00000100:00100000:2.0:1789128990.660358:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128990.660911:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626499072 00000100:00100000:3.0:1789128990.660926:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626499072 00010000:00010000:3.0:1789128990.660976:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c0722c4b/0x5c74554e47ce4022 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce401b expref: 12 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128990.661235:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789128990.661245:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f4fba1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:3306:x1876037626499072:12345-0@lo:103: 00010000:00010000:3.0:1789128990.661261:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789128990.661265:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c0722c4b/0x5c74554e47ce4022 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce401b expref: 12 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661277:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c0722c4b/0x5c74554e47ce4022 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce401b expref: 12 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661295:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c0722c4b/0x5c74554e47ce4022 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce401b expref: 12 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661311:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661318:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661334:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661340:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661344:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661362:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661368:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003ea5cecc already unused, calling callback (00000000d9dfde41) 00010000:00010000:3.0:1789128990.661372:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661380:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661399:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661411:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789128990.661479:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f4fba1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:3306:x1876037626499072:12345-0@lo:103: Request processed in 236us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128990.661486:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789128990.661514:0:6319:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661520:0:6319:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128990.661525:0:6319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce4061 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6319 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789128990.663339:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0979d21 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626499072:0@lo:103: 00010000:00010000:1.0:1789128990.855072:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128991.880139:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789128992.901770:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128993.928251:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789128994.565994:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d77d112d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626499200:0@lo:400: 00000100:00100000:3.0:1789128994.566125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128994.566216:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789128994.566223:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a9cb570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626499328:0@lo:400: 00000100:00100000:3.0:1789128994.566259:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128994.566296:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626499200 00000100:00100000:3.0:1789128994.566304:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626499200 00000100:00100000:3.0:1789128994.566359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789128994.566371:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccfa8566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:3308:x1876037626499200:12345-0@lo:400: 00000100:00100000:3.0:1789128994.566427:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccfa8566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:3308:x1876037626499200:12345-0@lo:400: Request processed in 60us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128994.566435:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789128994.566476:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626499328 00000100:00100000:3.0:1789128994.566480:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626499328 00000100:00100000:3.0:1789128994.566809:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789128994.566818:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d09b73e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626499328:12345-0@lo:400: 00000100:00100000:3.0:1789128994.566855:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d09b73e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626499328:12345-0@lo:400: Request processed in 41us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128994.566862:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789128994.567137:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004a9cb570 x1876037626499328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789128994.567156:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a9cb570 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626499328:0@lo:400: 00000100:00100000:3.0:1789128994.567169:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d77d112d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626499200:0@lo:400: 00010000:00010000:1.0:1789128994.952300:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128995.986126:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789128996.999638:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789128997.126955:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789128997.126966:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4921dd800 from 1 10000000:01000000:1.0:1789128997.126971:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789128997.127034:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: 00000000856aa987/0x5c74554e47ce4068 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789128997.127049:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: 00000000856aa987/0x5c74554e47ce4068 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789128997.127061:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: 00000000856aa987/0x5c74554e47ce4068 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789128997.127091:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c6ae0481 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626499456:0@lo:101: 00000100:00100000:1.0:1789128997.127182:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128997.127246:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086089a4b going to sleep for 11 seconds 00000100:00100000:3.0:1789128997.128076:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626499456 00000100:00100000:3.0:1789128997.128090:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626499456 00000100:00100000:3.0:1789128997.128158:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789128997.128177:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026f576db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:5837:x1876037626499456:12345-0@lo:101: 00010000:00010000:3.0:1789128997.128196:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789128997.128215:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce406f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4068 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128997.128248:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce406f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4068 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128997.128261:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003ea5cecc/0x5c74554e47ce406f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4068 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128997.128274:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003ea5cecc, rc 0) 00000100:00100000:3.0:1789128997.128344:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026f576db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5837:x1876037626499456:12345-0@lo:101: Request processed in 169us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128997.128353:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789128997.129018:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c6ae0481 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626499456:0@lo:101: 00010000:00010000:0.0:1789128997.129043:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: 00000000856aa987/0x5c74554e47ce4068 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789128997.129053:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: 00000000856aa987/0x5c74554e47ce4068 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789128997.129142:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b057fe7a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626499584:0@lo:501: 00000100:00100000:0.0:1789128997.129191:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789128997.129222:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000002505d5f6 going to sleep for 11 seconds 00000100:00100000:3.0:1789128997.129816:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626499584 00000100:00100000:3.0:1789128997.129836:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626499584 00000100:00100000:3.0:1789128997.129883:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789128997.129891:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007db5b227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5837:x1876037626499584:12345-0@lo:501: 00000100:00100000:3.0:1789128997.130223:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007db5b227 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5837:x1876037626499584:12345-0@lo:501: Request processed in 333us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128997.130232:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789128997.130382:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b057fe7a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626499584:0@lo:501: 00000100:00100000:3.0:1789128997.130430:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626499712:0@lo:503: 00000100:00100000:3.0:1789128997.130472:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128997.130503:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f5f66b66 going to sleep for 11 seconds 00000100:00100000:3.0:1789128997.130517:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626499712 00000100:00100000:3.0:1789128997.130527:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626499712 00000100:00100000:3.0:1789128997.130551:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789128997.130556:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efa9cd8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5837:x1876037626499712:12345-0@lo:503: 00000100:00100000:3.0:1789128997.130774:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efa9cd8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5837:x1876037626499712:12345-0@lo:503: Request processed in 218us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128997.130781:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789128997.130834:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626499712:0@lo:503: 00000100:00100000:3.0:1789128997.131065:0:6630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6630:1876037626499840:0@lo:502: 00000100:00100000:3.0:1789128997.131104:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128997.131125:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626499840 00000100:00100000:3.0:1789128997.131129:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626499840 00000100:00100000:3.0:1789128997.131152:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789128997.131159:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2735510 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6630:x1876037626499840:12345-0@lo:502: 00000100:00100000:3.0:1789128997.131302:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2735510 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6630:x1876037626499840:12345-0@lo:502: Request processed in 144us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128997.131310:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789128997.131339:0:6630:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a32dd5d going to sleep for 11 seconds 00000100:00100000:3.0:1789128997.131352:0:6630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037f9ba4e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6630:1876037626499840:0@lo:502: 00000020:01000000:3.0:1789128997.131376:0:6630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789128997.131388:0:6630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789128997.131391:0:6630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789128997.131400:0:6630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b4921dd800 00000020:00000080:3.0:1789128997.131403:0:6630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789128997.131453:0:6630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6630:1876037626499968:0@lo:502: 00000100:00100000:3.0:1789128997.131485:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128997.131504:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626499968 00000100:00100000:3.0:1789128997.131507:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626499968 00000100:00100000:3.0:1789128997.131537:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789128997.131543:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6630:x1876037626499968:12345-0@lo:502: 00000100:00100000:3.0:1789128997.131664:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6630:x1876037626499968:12345-0@lo:502: Request processed in 121us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128997.131672:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789128997.131696:0:6630:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856e6900 going to sleep for 11 seconds 00000100:00100000:3.0:1789128997.131706:0:6630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6630:1876037626499968:0@lo:502: 00000020:01000000:3.0:1789128997.131724:0:6630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789128997.131728:0:6630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789128997.131729:0:6630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789128997.131733:0:6630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789128997.131791:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789128997.131812:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789128997.131835:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481656800/0x5c74554e47ce4068 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128997.131848:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b481656800/0x5c74554e47ce4068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128998.034665:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128999.046218:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789128999.685938:0:6684:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789128999.685943:0:6684:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789128999.686104:0:6684:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90b492084000 00000100:00100000:2.0:1789128999.686555:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626500096:0@lo:400: 00000100:00100000:2.0:1789128999.686664:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789128999.686886:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626500096 00000100:00100000:0.0:1789128999.686896:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626500096 00000100:00100000:0.0:1789128999.686960:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789128999.686972:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:3306:x1876037626500096:12345-0@lo:400: 00000100:00100000:0.0:1789128999.687038:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:3306:x1876037626500096:12345-0@lo:400: Request processed in 66us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128999.687047:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789128999.687139:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626500096:0@lo:400: 00000100:00100000:2.0:1789128999.687166:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789128999.687173:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626500224:0@lo:400: 00000100:00100000:2.0:1789128999.687201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1789128999.687374:0:6684:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789128999.687387:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789128999.687403:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90b487cb4ed8) 00000020:00000080:1.0:1789128999.687420:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00000100:00100000:0.0:1789128999.688916:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626500224 00000100:00100000:0.0:1789128999.688931:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626500224 00000100:00100000:0.0:1789128999.689056:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789128999.689068:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626500224:12345-0@lo:400: 00000100:00100000:0.0:1789128999.689172:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626500224:12345-0@lo:400: Request processed in 106us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789128999.689180:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789128999.690983:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b498b212c0 x1876037626500224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789128999.691006:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626500224:0@lo:400: 00100000:10000000:2.0:1789128999.705036:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789128999.705934:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789128999.727045:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789128999.733396:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789128999.733433:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789128999.733494:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789128999.733519:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789128999.734205:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789128999.734221:0:6684:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789128999.734240:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5c74554e47ce407d 00000020:01000004:2.0:1789128999.734249:0:6684:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789128999.734277:0:6684:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789128999.734281:0:6684:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789128999.734288:0:6684:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789128999.734293:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789128999.734306:0:6684:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90b487c70000) 00000020:00000080:2.0:1789128999.734320:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789128999.735874:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789128999.736087:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789128999.736093:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789128999.740566:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789128999.740582:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789128999.741113:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789128999.741122:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789128999.742909:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789128999.743150:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789128999.743158:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789128999.744916:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789128999.744933:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789128999.769997:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789128999.770265:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789128999.770271:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789128999.772399:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789128999.772417:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789128999.774123:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789128999.774140:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789128999.777885:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789128999.778114:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789128999.778121:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789128999.780044:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789128999.780061:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789128999.818171:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789128999.818443:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789128999.818462:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789128999.823635:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789128999.823656:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789128999.824446:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789128999.824478:0:6684:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789128999.824486:0:6684:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789128999.887290:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789128999.887334:0:6684:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.139@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789128999.887339:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789128999.887341:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789128999.887346:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789128999.887347:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789128999.887349:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789128999.887350:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789128999.887351:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789128999.887353:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789128999.887354:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789128999.887356:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789128999.887357:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789128999.887361:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789128999.887363:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789128999.887365:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789128999.887366:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789128999.887367:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789128999.887368:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789128999.887369:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789128999.887370:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789128999.887370:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789128999.887371:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789128999.887372:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789128999.887373:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789128999.887405:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789128999.887426:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626500352:0@lo:253: 00000100:00100000:1.0:1789128999.887499:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789128999.887557:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486773d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789128999.888693:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626500352 00000100:00100000:0.0:1789128999.888703:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626500352 00000100:00100000:0.0:1789128999.888772:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789128999.888821:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626500352:12345-0@lo:253: 20000000:01000000:0.0:1789128999.888864:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789128999.888870:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789128999.888876:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789128999.888881:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789128999.890000:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789128999.890205:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789128999.890219:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789128999.890261:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789128999.890270:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789128999.890300:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789128999.890367:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789128999.891208:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789128999.891230:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.139@tcp 20000000:01000000:0.0:1789128999.891232:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.139@tcp (null) (null) (null) 00000040:00080000:0.0:1789128999.891579:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789128999.891592:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789128999.892665:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789128999.892694:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.139@tcp (null) (null) 00000040:00080000:0.0:1789128999.892790:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789128999.892872:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789128999.892912:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789128999.892979:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789128999.903246:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789128999.903356:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.139@tcp 20000000:01000000:0.0:1789128999.903359:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.139@tcp (null) (null) (null) 00000040:00080000:0.0:1789128999.903522:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789128999.903533:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789128999.903566:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789128999.903574:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.139@tcp (null) (null) 00000040:00080000:0.0:1789128999.903661:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789128999.903674:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789128999.903726:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789128999.903764:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789128999.903792:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789128999.903795:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789128999.903801:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789128999.903802:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789128999.903804:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789128999.903816:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789128999.903819:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789128999.903856:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789128999.903859:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789128999.908138:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789128999.908254:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789128999.908307:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789128999.909207:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789128999.909259:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789128999.909289:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789128999.909304:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789128999.909307:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789128999.911517:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789128999.912508:0:6700:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789128999.913663:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789128999.919811:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789128999.919874:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789128999.919958:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789128999.919982:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789128999.919985:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789128999.921386:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789128999.922277:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789128999.922333:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789128999.922409:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:2.0:1789128999.922432:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789128999.922464:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128999.922489:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b480031a00/0x5c74554e47ce3fa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce3f9d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128999.922497:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b489b87e00/0x5c74554e47ce3fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce3fb9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128999.922506:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b480031e00/0x5c74554e47ce4030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4029 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128999.922514:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128999.922575:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b480031e00/0x5c74554e47ce4030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4029 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128999.922596:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b480031e00/0x5c74554e47ce4030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4029 expref: 12 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789128999.922913:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626500480:0@lo:104: 00000100:00100000:2.0:1789128999.923013:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789128999.923299:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b489b87e00/0x5c74554e47ce3fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce3fb9 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128999.923312:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b489b87e00/0x5c74554e47ce3fc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce3fb9 expref: 12 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789128999.923333:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af21c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626500608:0@lo:104: 00000100:00100000:2.0:1789128999.923360:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789128999.923456:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b480031a00/0x5c74554e47ce3fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce3f9d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128999.923465:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b480031a00/0x5c74554e47ce3fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce3f9d expref: 12 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789128999.923473:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626500736:0@lo:104: 00000100:00100000:2.0:1789128999.923496:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789128999.947836:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143480 going to sleep for 11 seconds 00000100:00100000:0.0:1789128999.948394:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626500480 00000100:00100000:0.0:1789128999.948408:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626500480 00000100:00100000:3.0:1789128999.948667:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626500608 00000100:00100000:3.0:1789128999.948672:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626500608 00000100:00100000:3.0:1789128999.948686:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626500736 00000100:00100000:3.0:1789128999.948688:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626500736 00000100:00100000:3.0:1789128999.948707:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789128999.948717:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:5834:x1876037626500480:12345-0@lo:104: 00010000:00010000:3.0:1789128999.948742:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b481656a00/0x5c74554e47ce4029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.948871:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789128999.948879:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:5834:x1876037626500480:12345-0@lo:104: Request processed in 164us (25866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128999.948887:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789128999.948909:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789128999.948916:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:5834:x1876037626500608:12345-0@lo:104: 00010000:00010000:3.0:1789128999.948925:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce3fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.948960:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789128999.948965:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:5834:x1876037626500608:12345-0@lo:104: Request processed in 51us (25604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128999.948992:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789128999.949005:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789128999.949012:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:5834:x1876037626500736:12345-0@lo:104: 00010000:00010000:3.0:1789128999.949021:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce3f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949050:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789128999.949055:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:5834:x1876037626500736:12345-0@lo:104: Request processed in 44us (25559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128999.949075:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789128999.949093:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789128999.949100:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b481656a00/0x5c74554e47ce4029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949108:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656a00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789128999.949112:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b481656a00/0x5c74554e47ce4029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949354:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b481656a00/0x5c74554e47ce4029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789128999.949365:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b481656a00/0x5c74554e47ce4029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789128999.949371:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789128999.949415:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b481656a00/0x5c74554e47ce4029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949422:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789128999.949452:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b481656a00/0x5c74554e47ce4029 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949460:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b481656a00/0x5c74554e47ce4029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4030 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949475:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789128999.949478:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce3fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949484:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b200 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789128999.949486:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce3fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949492:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce3fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789128999.949498:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce3fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789128999.949503:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789128999.949518:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce3fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949523:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789128999.949528:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce3fb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949534:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce3fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce3fc0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949543:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789128999.949553:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce3f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949558:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151bc00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789128999.949561:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce3f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949567:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce3f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789128999.949573:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce3f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789128999.949578:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789128999.949590:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce3f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949595:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789128999.949669:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce3f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949677:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce3f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce3fa4 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.949692:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128999.949695:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128999.949697:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789128999.949704:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789128999.949728:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626500864:0@lo:103: 00000100:00100000:3.0:1789128999.949901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128999.949948:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789128999.949961:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626500992:0@lo:103: 00000100:00100000:3.0:1789128999.949986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128999.950015:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626501120:0@lo:103: 00000100:00100000:3.0:1789128999.950038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789128999.950285:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626500864 00000100:00100000:3.0:1789128999.950293:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626500864 00010000:00010000:3.0:1789128999.950322:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b480031e00/0x5c74554e47ce4030 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4029 expref: 13 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128999.950341:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626500992 00000100:00100000:3.0:1789128999.950343:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626500992 00010000:00010000:3.0:1789128999.950352:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b489b87e00/0x5c74554e47ce3fc0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce3fb9 expref: 14 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128999.950362:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626501120 00000100:00100000:3.0:1789128999.950365:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626501120 00010000:00010000:3.0:1789128999.950374:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b480031a00/0x5c74554e47ce3fa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce3f9d expref: 15 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128999.950387:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789128999.950396:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:3308:x1876037626500864:12345-0@lo:103: 00010000:00010000:3.0:1789128999.950411:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789128999.950416:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b480031e00/0x5c74554e47ce4030 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4029 expref: 15 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.950429:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b480031e00/0x5c74554e47ce4030 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4029 expref: 15 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.950451:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789128999.950496:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:3308:x1876037626500864:12345-0@lo:103: Request processed in 100us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128999.950510:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789128999.950527:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789128999.950532:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:3308:x1876037626500992:12345-0@lo:103: 00010000:00010000:3.0:1789128999.950539:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789128999.950543:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b489b87e00/0x5c74554e47ce3fc0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce3fb9 expref: 14 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.950551:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b489b87e00/0x5c74554e47ce3fc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce3fb9 expref: 14 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.950559:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789128999.950578:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:3308:x1876037626500992:12345-0@lo:103: Request processed in 46us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789128999.950584:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789128999.950595:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789128999.950901:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626500992:0@lo:103: 00000100:00100000:0.0:1789128999.950911:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626500864:0@lo:103: 00010000:00010000:2.0:1789128999.951023:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480031e00/0x5c74554e47ce4030 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4029 expref: 13 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789128999.951037:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626500480:0@lo:104: 00010000:00010000:2.0:1789128999.951057:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b87e00/0x5c74554e47ce3fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce3fb9 expref: 12 pid: 5835 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789128999.951076:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af21c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626500608:0@lo:104: 00000100:00100000:2.0:1789128999.951084:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626500736:0@lo:104: 00010000:00010000:2.0:1789128999.951111:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789128999.951279:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:3306:x1876037626501120:12345-0@lo:103: 00010000:00010000:3.0:1789128999.951292:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789128999.951299:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b480031a00/0x5c74554e47ce3fa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce3f9d expref: 11 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.951309:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b480031a00/0x5c74554e47ce3fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce3f9d expref: 11 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.951388:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480031a00/0x5c74554e47ce3fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce3f9d expref: 11 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.951405:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.951425:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.951442:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.951449:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.951456:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.951463:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.951470:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789128999.951474:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.951482:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128999.966989:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789128999.967017:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789128999.967029:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:3.0:1789128999.976649:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.976676:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b86000/0x5c74554e47ce408b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789128999.976705:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789128999.985314:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:3306:x1876037626501120:12345-0@lo:103: Request processed in 34699us (35261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789128999.985337:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789128999.985429:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626501120:0@lo:103: 00010000:00010000:2.0:1789129000.071827:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129000.129996:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:6684:x1876037626500352:12345-0@lo:253: Request processed in 241164us (242482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129000.130015:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789129000.130243:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626500352:0@lo:253: 10000000:01000000:1.0:1789129000.130264:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789129000.130268:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789129000.130270:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789129000.130272:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789129000.130273:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789129000.130274:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789129000.130276:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789129000.130277:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789129000.130297:0:6684:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789129000.130299:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789129000.130301:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789129000.130341:0:6684:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90b492084000 from lustre-OST0000 10000000:01000000:1.0:1789129000.130377:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789129000.130380:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789129000.130389:0:6684:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90b487c73490 local copy 10000000:01000000:1.0:1789129000.130394:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789129000.130444:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.130457:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.130468:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129000.130491:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626501248:0@lo:101: 00000100:00100000:1.0:1789129000.130535:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129000.130655:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789129000.130831:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626501248 00000100:00100000:3.0:1789129000.130839:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626501248 00000100:00100000:3.0:1789129000.130892:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789129000.130901:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:6684:x1876037626501248:12345-0@lo:101: 00010000:00010000:3.0:1789129000.130918:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129000.130934:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151bc00/0x5c74554e47ce4099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4092 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.130963:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151bc00/0x5c74554e47ce4099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4092 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.130974:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151bc00/0x5c74554e47ce4099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4092 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.130986:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151bc00, rc 0) 00000100:00100000:3.0:1789129000.131032:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:6684:x1876037626501248:12345-0@lo:101: Request processed in 131us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129000.131039:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789129000.132891:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626501248:0@lo:101: 00010000:00010000:1.0:1789129000.132937:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.132954:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129000.133136:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626501376:0@lo:501: 00000100:00100000:1.0:1789129000.133202:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129000.133259:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1789129000.133463:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626501376 00000100:00100000:0.0:1789129000.133472:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626501376 00000100:00100000:0.0:1789129000.133535:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789129000.133547:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:6684:x1876037626501376:12345-0@lo:501: 00000100:00100000:0.0:1789129000.133915:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:6684:x1876037626501376:12345-0@lo:501: Request processed in 370us (712us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789129000.133924:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789129000.134499:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626501376:0@lo:501: 10000000:01000000:1.0:1789129000.134534:0:6684:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789129000.134578:0:6684:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789129000.134587:0:6684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.134645:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.134654:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.134682:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789129000.134820:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b492084000 10000000:01000000:1.0:1789129000.134826:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789129000.134833:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90b487c73490 10000000:01000000:1.0:1789129000.134835:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789129000.134839:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90b487c73490 from 1 10000000:01000000:1.0:1789129000.134842:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789129000.134880:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481657000/0x5c74554e47ce40a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.134890:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b481657000/0x5c74554e47ce40a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.134901:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b481657000/0x5c74554e47ce40a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129000.134921:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626501504:0@lo:101: 00000100:00100000:1.0:1789129000.134970:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129000.135012:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5c00 going to sleep for 11 seconds 00010000:00010000:3.0:1789129000.135305:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129000.135313:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.135332:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481657200 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789129000.135337:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.135346:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789129000.135354:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129000.135373:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789129000.135401:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.135408:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789129000.135451:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.135458:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b481657200/0x5c74554e47ce4092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5c74554e47ce4099 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.135478:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129000.135480:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129000.135482:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129000.135592:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789129000.135648:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626501632:0@lo:103: 00000100:00100000:2.0:1789129000.135707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129000.136019:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626501632 00000100:00100000:3.0:1789129000.136027:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626501632 00000100:00100000:3.0:1789129000.136555:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789129000.136568:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:3306:x1876037626501632:12345-0@lo:103: 00010000:00010000:3.0:1789129000.136583:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789129000.136759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626501504 00000100:00100000:0.0:1789129000.136784:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626501504 00000100:00100000:0.0:1789129000.136815:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789129000.136823:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626501504:12345-0@lo:101: 00010000:00010000:0.0:1789129000.136839:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129000.136857:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b480030c00/0x5c74554e47ce40a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce40a0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.136883:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b480030c00/0x5c74554e47ce40a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce40a0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.136895:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b480030c00/0x5c74554e47ce40a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce40a0 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.136905:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030c00, rc 0) 00000100:00100000:0.0:1789129000.136966:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626501504:12345-0@lo:101: Request processed in 144us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129000.136973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789129000.137152:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626501504:0@lo:101: 00010000:00010000:1.0:1789129000.137171:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b481657000/0x5c74554e47ce40a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40a7 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.137181:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b481657000/0x5c74554e47ce40a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce40a7 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129000.137203:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789129000.137222:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481657000/0x5c74554e47ce40a0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40a7 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.137230:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b481657000/0x5c74554e47ce40a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40a7 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129000.137239:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789129000.137243:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789129000.137250:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789129000.137253:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789129000.137276:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.137284:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.137292:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129000.137309:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626501760:0@lo:101: 00010000:00010000:3.0:1789129000.137435:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151bc00/0x5c74554e47ce4099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce4092 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.137453:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129000.137495:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:3306:x1876037626501632:12345-0@lo:103: Request processed in 930us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129000.137503:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789129000.137674:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626501632:0@lo:103: 00000100:00100000:1.0:1789129000.137941:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129000.137990:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129000.138558:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626501760 00000100:00100000:3.0:1789129000.138568:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626501760 00000100:00100000:3.0:1789129000.138663:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789129000.138683:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+10:6684:x1876037626501760:12345-0@lo:101: 00010000:00010000:3.0:1789129000.138811:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129000.138834:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151b200/0x5c74554e47ce40b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce40ae expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.138864:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151b200/0x5c74554e47ce40b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce40ae expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.138876:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151b200/0x5c74554e47ce40b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce40ae expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.138885:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b200, rc 0) 00000100:00100000:3.0:1789129000.138947:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626501760:12345-0@lo:101: Request processed in 266us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129000.138954:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789129000.139387:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626501760:0@lo:101: 00010000:00010000:1.0:1789129000.139408:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.139417:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129000.139552:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626501888:0@lo:501: 00000100:00100000:1.0:1789129000.139591:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129000.139666:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789129000.139914:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626501888 00000100:00100000:0.0:1789129000.139921:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626501888 00000100:00100000:0.0:1789129000.139963:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789129000.139972:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626501888:12345-0@lo:501: 00000100:00100000:0.0:1789129000.140722:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626501888:12345-0@lo:501: Request processed in 746us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129000.140733:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789129000.145530:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626501888:0@lo:501: 00000100:00100000:0.0:1789129000.155669:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502016:0@lo:503: 00000100:00100000:0.0:1789129000.155826:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129000.155899:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b492287a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789129000.156132:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626502016 00000100:00100000:3.0:1789129000.156143:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626502016 00000100:00100000:3.0:1789129000.156208:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789129000.156219:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626502016:12345-0@lo:503: 00000100:00100000:3.0:1789129000.156491:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626502016:12345-0@lo:503: Request processed in 273us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129000.156500:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789129000.160164:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b21680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502016:0@lo:503: 00000040:00080000:1.0:1789129000.160735:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789129000.160857:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502144:0@lo:502: 00000100:00100000:1.0:1789129000.160952:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129000.161005:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789129000.161490:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626502144 00000100:00100000:0.0:1789129000.161509:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626502144 00000100:00100000:0.0:1789129000.161573:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789129000.161584:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626502144:12345-0@lo:502: 00000100:00100000:0.0:1789129000.161892:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626502144:12345-0@lo:502: Request processed in 309us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129000.161902:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789129000.163034:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502144:0@lo:502: 00000040:00080000:1.0:1789129000.165376:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789129000.165463:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789129000.165496:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789129000.165539:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789129000.165572:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789129000.165635:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789129000.165709:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502272:0@lo:502: 00000100:00100000:1.0:1789129000.165825:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129000.165897:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789129000.167131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626502272 00000100:00100000:0.0:1789129000.167149:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626502272 00000100:00100000:0.0:1789129000.167225:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789129000.167238:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626502272:12345-0@lo:502: 00000100:00100000:0.0:1789129000.167547:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626502272:12345-0@lo:502: Request processed in 311us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129000.167557:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789129000.169135:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502272:0@lo:502: 00000040:00080000:1.0:1789129000.169363:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789129000.169381:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789129000.171988:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789129000.172005:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789129000.172014:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129000.172017:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789129000.172025:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789129000.172044:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90b4bb020000) 00000020:00000080:3.0:1789129000.172084:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789129000.172105:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789129000.172207:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b492084000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789129000.172217:0:6702:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789129000.172235:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5c74554e47ce40c3 00010000:00010000:3.0:1789129000.178375:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789129000.179026:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789129000.182488:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789129000.182983:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789129000.217176:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789129000.232393:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789129000.239426:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789129000.239443:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789129000.239450:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129000.239452:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789129000.239456:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789129000.239461:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129000.239462:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789129000.239466:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789129000.239468:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789129000.239516:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789129000.239519:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129000.239520:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789129000.239523:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789129000.239813:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789129000.239844:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789129000.239925:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.239955:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129000.239964:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b492084000 from 1 10000000:01000000:2.0:1789129000.239966:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789129000.240009:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.240017:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.240031:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129000.240057:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502400:0@lo:101: 00000100:00100000:2.0:1789129000.240137:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129000.240199:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789129000.240432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626502400 00000100:00100000:1.0:1789129000.240441:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626502400 00000100:00100000:1.0:1789129000.240496:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789129000.240505:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:6684:x1876037626502400:12345-0@lo:101: 00010000:00010000:1.0:1789129000.240521:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129000.240537:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b481656e00/0x5c74554e47ce40d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce40ca expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.240563:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656e00/0x5c74554e47ce40d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce40ca expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.240574:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b481656e00/0x5c74554e47ce40d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce40ca expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.240584:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656e00, rc 0) 00000100:00100000:1.0:1789129000.240657:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626502400:12345-0@lo:101: Request processed in 152us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129000.240664:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789129000.240766:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502400:0@lo:101: 00010000:00010000:2.0:1789129000.240793:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.240803:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129000.240904:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502528:0@lo:501: 00000100:00100000:2.0:1789129000.240928:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129000.240951:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789129000.240973:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626502528 00000100:00100000:2.0:1789129000.240977:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626502528 00000100:00100000:2.0:1789129000.240999:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789129000.241005:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626502528:12345-0@lo:501: 00000100:00100000:2.0:1789129000.241235:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626502528:12345-0@lo:501: Request processed in 229us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129000.241242:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789129000.241270:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502528:0@lo:501: 00000100:00100000:2.0:1789129000.241293:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502656:0@lo:503: 00000100:00100000:2.0:1789129000.242840:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129000.242907:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789129000.242943:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626502656 00000100:00100000:2.0:1789129000.242952:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626502656 00000100:00100000:2.0:1789129000.243004:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789129000.243012:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626502656:12345-0@lo:503: 00000100:00100000:2.0:1789129000.249039:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626502656:12345-0@lo:503: Request processed in 6012us (7699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129000.249060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789129000.251229:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502656:0@lo:503: 00000040:00080000:0.0:1789129000.254366:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789129000.254526:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502784:0@lo:502: 00000100:00100000:0.0:1789129000.254657:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129000.254795:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626502784 00000100:00100000:1.0:1789129000.254810:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626502784 00000100:00100000:1.0:1789129000.254866:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789129000.254878:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626502784:12345-0@lo:502: 00000100:00100000:0.0:1789129000.255137:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b492195480 going to sleep for 11 seconds 00000100:00100000:1.0:1789129000.255382:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626502784:12345-0@lo:502: Request processed in 504us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129000.255391:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789129000.257083:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502784:0@lo:502: 00000040:00080000:0.0:1789129000.257535:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789129000.257597:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789129000.257676:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502912:0@lo:502: 00000100:00100000:0.0:1789129000.257765:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129000.257819:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b492195480 going to sleep for 11 seconds 00000100:00100000:2.0:1789129000.258653:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626502912 00000100:00100000:2.0:1789129000.258683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626502912 00000100:00100000:2.0:1789129000.258761:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789129000.258787:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626502912:12345-0@lo:502: 00000100:00100000:2.0:1789129000.259238:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626502912:12345-0@lo:502: Request processed in 466us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129000.259247:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789129000.259353:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626502912:0@lo:502: 00000040:00080000:0.0:1789129000.259551:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789129000.259569:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789129000.264909:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789129000.264932:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129000.264935:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789129000.264944:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b492084000 00000020:00000080:1.0:1789129000.264947:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789129000.264972:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789129000.264976:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129000.264977:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789129000.264992:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789129000.265213:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789129000.265247:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789129000.265274:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.265288:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129000.265339:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789129000.265343:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b492084000 10000000:01000000:0.0:1789129000.265346:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b492084000 10000000:01000000:0.0:1789129000.265351:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789129000.265357:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b492084000 from 1 10000000:01000000:0.0:1789129000.265360:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789129000.265411:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.265422:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.265436:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129000.265466:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503040:0@lo:101: 00000100:00100000:0.0:1789129000.265571:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129000.265667:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b492195b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129000.265914:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626503040 00000100:00100000:1.0:1789129000.265923:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626503040 00000100:00100000:1.0:1789129000.266032:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789129000.266044:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626503040:12345-0@lo:101: 00010000:00010000:1.0:1789129000.266063:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129000.266079:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b481656200/0x5c74554e47ce40df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce40d8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.266108:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656200/0x5c74554e47ce40df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce40d8 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.266146:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b481656200/0x5c74554e47ce40df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce40d8 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129000.266157:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656200, rc 0) 00000100:00100000:1.0:1789129000.266223:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6684:x1876037626503040:12345-0@lo:101: Request processed in 182us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129000.266231:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789129000.266314:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503040:0@lo:101: 00010000:00010000:3.0:1789129000.266332:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.266342:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129000.266458:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503168:0@lo:501: 00000100:00100000:3.0:1789129000.266489:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129000.275844:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911180 going to sleep for 11 seconds 00000100:00100000:0.0:1789129000.275922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626503168 00000100:00100000:0.0:1789129000.275934:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626503168 00000100:00100000:2.0:1789129000.276254:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789129000.276267:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6684:x1876037626503168:12345-0@lo:501: 00000100:00100000:2.0:1789129000.276698:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6684:x1876037626503168:12345-0@lo:501: Request processed in 433us (10207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129000.276708:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789129000.276885:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503168:0@lo:501: 00000100:00100000:3.0:1789129000.276956:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503296:0@lo:503: 00000100:00100000:2.0:1789129000.277176:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129000.277215:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911180 going to sleep for 11 seconds 00000100:00100000:0.0:1789129000.277280:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626503296 00000100:00100000:0.0:1789129000.277287:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626503296 00000100:00100000:0.0:1789129000.277319:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789129000.277328:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6684:x1876037626503296:12345-0@lo:503: 00000100:00100000:0.0:1789129000.277530:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6684:x1876037626503296:12345-0@lo:503: Request processed in 202us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129000.277537:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789129000.277639:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503296:0@lo:503: 00000040:00080000:2.0:1789129000.278008:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789129000.278093:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503424:0@lo:502: 00000100:00100000:2.0:1789129000.278133:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129000.278170:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129000.278422:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626503424 00000100:00100000:0.0:1789129000.278429:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626503424 00000100:00100000:0.0:1789129000.278463:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789129000.278472:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6684:x1876037626503424:12345-0@lo:502: 00000100:00100000:0.0:1789129000.278716:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6684:x1876037626503424:12345-0@lo:502: Request processed in 245us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129000.278725:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789129000.281410:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503424:0@lo:502: 00000040:00080000:2.0:1789129000.281871:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789129000.281943:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789129000.281976:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789129000.283123:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789129000.283169:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789129000.283219:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789129000.283256:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789129000.283291:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789129000.283336:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789129000.283375:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789129000.283405:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789129000.283478:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789129000.283514:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789129000.283546:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789129000.283591:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789129000.283656:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789129000.283690:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789129000.283751:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789129000.283812:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789129000.283847:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789129000.283909:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789129000.283947:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789129000.283979:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789129000.284025:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789129000.284062:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789129000.284097:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789129000.284144:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789129000.284197:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1789129000.284265:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503552:0@lo:502: 00000100:00100000:2.0:1789129000.286251:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129000.286372:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129000.295962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626503552 00000100:00100000:0.0:1789129000.295997:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626503552 00000100:00100000:1.0:1789129000.296249:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789129000.296265:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6684:x1876037626503552:12345-0@lo:502: 00000100:00100000:1.0:1789129000.296669:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6684:x1876037626503552:12345-0@lo:502: Request processed in 406us (10426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129000.296678:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789129000.296876:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503552:0@lo:502: 00000040:00080000:2.0:1789129000.297032:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789129000.297050:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789129000.299667:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789129000.299689:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90b487c71a48) 00000020:00000080:2.0:1789129000.299717:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1789129000.299867:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b492084000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789129000.299872:0:6707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b492084000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789129000.299875:0:6707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b492084000 3 00010000:00080000:2.0:1789129000.299921:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b381968800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.139@tcp at head 00010000:00010000:2.0:1789129000.316764:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789129000.317144:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789129000.317191:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789129000.317210:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5c74554e47ce40ed 00000100:00080000:2.0:1789129000.317224:0:6707:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789129000.317232:0:6707:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90b381968800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1789129000.317286:0:6707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b497af0780 x1876037626503680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789129000.317346:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789129000.317430:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626503680:0@lo:38: 00000100:00100000:2.0:1789129000.317452:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626503808:0@lo:400: 00000100:00100000:2.0:1789129000.320525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129000.325361:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626503808 00000100:00100000:3.0:1789129000.325385:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626503808 00000100:00100000:3.0:1789129000.325488:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789129000.325501:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626503808:12345-0@lo:400: 00000100:00100000:1.0:1789129000.325746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129000.325888:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789129000.325900:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789129000.329878:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789129000.329907:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626503680 00000100:00100000:2.0:1789129000.329920:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626503680 00000100:00100000:2.0:1789129000.329961:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789129000.329975:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789129000.330002:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876037626503680:12345-0@lo:38: 00010000:00080000:2.0:1789129000.330044:0:5840:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:2.0:1789129000.330099:0:5840:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5c74554e47ce40f4 00000004:00100000:2.0:1789129000.330121:0:5840:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789129000.330167:0:5840:0:(import.c:65:import_set_state_nolock()) ffff90b381969800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789129000.330289:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876037626503680:12345-0@lo:38: Request processed in 289us (4543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129000.330297:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1789129000.330709:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1789129000.331205:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626503808:12345-0@lo:400: Request processed in 5705us (10690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129000.331217:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:3.0:1789129000.331294:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789129000.331333:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789129000.331353:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129000.331365:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789129000.331428:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789129000.331430:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789129000.331432:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129000.331433:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129000.331435:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129000.331437:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129000.331438:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789129000.331440:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789129000.331442:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789129000.331444:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129000.331445:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789129000.331450:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789129000.331452:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789129000.331453:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789129000.331454:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129000.331455:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129000.331457:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129000.331458:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129000.331459:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789129000.331460:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789129000.331461:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789129000.331461:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129000.331462:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789129000.331493:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789129000.331520:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503936:0@lo:253: 00000100:00100000:3.0:1789129000.331585:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129000.331655:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129000.331686:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626503936 00000100:00100000:3.0:1789129000.331698:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626503936 00000100:00100000:3.0:1789129000.331734:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789129000.331743:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6684:x1876037626503936:12345-0@lo:253: 00010000:00080000:2.0:1789129000.332234:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b497af2d00 x1876037626503808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129000.332253:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626503808:0@lo:400: 00010000:00080000:1.0:1789129000.333561:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b497af0780 x1876037626503680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789129010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129000.333582:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789129000.333593:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789129000.333624:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789129000.333631:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789129000.333635:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b381968800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789129000.333643:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626503680:0@lo:38: 20000000:01000000:3.0:1789129000.336428:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789129000.336458:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789129000.429654:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789129000.429677:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789129000.429783:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789129000.429789:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789129000.429818:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.429843:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b489b87800/0x5c74554e47ce405a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4053 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.429874:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.429930:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b489b87800/0x5c74554e47ce405a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4053 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.429948:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b489b87800/0x5c74554e47ce405a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4053 expref: 13 pid: 5833 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129000.429964:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876037626504064:0@lo:104: 00000100:00100000:2.0:1789129000.430071:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129000.430144:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49106b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789129000.430919:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626504064 00000100:00100000:0.0:1789129000.430932:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626504064 00000100:00100000:0.0:1789129000.431008:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789129000.431021:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:5856:x1876037626504064:12345-0@lo:104: 00010000:00010000:0.0:1789129000.431040:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce4053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.431132:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789129000.431139:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:5856:x1876037626504064:12345-0@lo:104: Request processed in 121us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129000.431147:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789129000.431174:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129000.431193:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce4053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.431202:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789129000.431207:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce4053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.431215:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce4053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129000.431223:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce4053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129000.431229:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789129000.431274:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce4053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.431281:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789129000.431306:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce4053 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.431314:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce4053 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce405a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129000.431346:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129000.431348:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129000.431349:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129000.431364:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626504192:0@lo:103: 00000100:00100000:0.0:1789129000.431407:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129000.432031:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626504192 00000100:00100000:2.0:1789129000.432040:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626504192 00010000:00010000:2.0:1789129000.432084:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b489b87800/0x5c74554e47ce405a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4053 expref: 14 pid: 5833 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129000.432113:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789129000.432122:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486564850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:3309:x1876037626504192:12345-0@lo:103: 00010000:00010000:2.0:1789129000.432134:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129000.432140:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b489b87800/0x5c74554e47ce405a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4053 expref: 14 pid: 5833 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432152:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b489b87800/0x5c74554e47ce405a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4053 expref: 14 pid: 5833 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432172:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432196:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789129000.432215:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006356198s 00010000:00010000:2.0:1789129000.432220:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432227:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432234:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432241:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432247:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129000.432251:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432259:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432267:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432277:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129000.432340:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486564850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:3309:x1876037626504192:12345-0@lo:103: Request processed in 218us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129000.432348:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789129000.432444:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b87800/0x5c74554e47ce405a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4053 expref: 13 pid: 5833 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129000.432458:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876037626504064:0@lo:104: 00010000:00010000:2.0:1789129000.432477:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432486:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432493:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129000.432499:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b86600/0x5c74554e47ce40fb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129000.434182:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626504192:0@lo:103: 00000100:00100000:3.0:1789129000.485207:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:6684:x1876037626503936:12345-0@lo:253: Request processed in 153449us (153605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129000.485225:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789129000.485657:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6684:1876037626503936:0@lo:253: 10000000:01000000:0.0:1789129000.485708:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789129000.485713:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789129000.485723:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789129000.485724:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789129000.485726:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789129000.485727:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789129000.485728:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789129000.485730:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789129000.485732:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789129000.485734:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789129000.485735:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789129000.485737:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789129000.486037:0:6684:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789129000.502687:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789129000.504296:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789129000.504569:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789129000.504815:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789129000.506366:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789129000.506578:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789129000.509438:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789129000.924960:0:6684:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789129000.924976:0:6684:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789129000.927092:0:6684:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789129000.927206:0:6684:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789129000.927236:0:6684:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789129000.927285:0:6684:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789129001.098064:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129002.124637:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129003.162182:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129004.168212:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129005.191284:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129005.319848:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626504320:0@lo:400: 00000100:00100000:2.0:1789129005.319944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129005.320259:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626504320 00000100:00100000:0.0:1789129005.320272:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626504320 00000100:00100000:0.0:1789129005.320332:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789129005.320425:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:3306:x1876037626504320:12345-0@lo:400: 00000100:00100000:3.0:1789129005.321136:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626504448:0@lo:400: 00000100:00100000:3.0:1789129005.321196:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129005.321502:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:3306:x1876037626504320:12345-0@lo:400: Request processed in 1157us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129005.321513:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789129005.321774:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626504320:0@lo:400: 00000100:00100000:2.0:1789129005.321814:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626504448 00000100:00100000:2.0:1789129005.321831:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626504448 00000100:00100000:2.0:1789129005.321913:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789129005.321923:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626504448:12345-0@lo:400: 00000100:00100000:2.0:1789129005.321987:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626504448:12345-0@lo:400: Request processed in 66us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129005.321994:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789129005.322056:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498ac4b40 x1876037626504448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129005.322069:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626504448:0@lo:400: 00000100:00100000:1.0:1789129005.322323:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626504576:0@lo:400: 00000100:00100000:1.0:1789129005.322372:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129005.322707:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626504576 00000100:00100000:3.0:1789129005.322713:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626504576 00000100:00100000:3.0:1789129005.322807:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789129005.322817:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626504576:12345-0@lo:400: 00000100:00100000:3.0:1789129005.322869:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626504576:12345-0@lo:400: Request processed in 54us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129005.322878:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789129005.323128:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789129005.323245:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498ac61c0 x1876037626504576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129005.323258:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626504576:0@lo:400: 10000000:01000000:3.0:1789129005.833294:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789129005.851067:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b4921dd800 from 21 10000000:01000000:3.0:1789129005.851074:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789129005.851120:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.851145:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.851158:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129005.851185:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626504704:0@lo:101: 00000100:00100000:3.0:1789129005.852434:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129005.852502:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129005.853161:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626504704 00000100:00100000:0.0:1789129005.853172:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626504704 00000100:00100000:0.0:1789129005.853230:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789129005.853241:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5837:x1876037626504704:12345-0@lo:101: 00010000:00010000:0.0:1789129005.853267:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129005.853286:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b480031800/0x5c74554e47ce4109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4102 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.853391:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b480031800/0x5c74554e47ce4109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4102 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.853405:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b480031800/0x5c74554e47ce4109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4102 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.853416:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031800, rc 0) 00000100:00100000:0.0:1789129005.853485:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626504704:12345-0@lo:101: Request processed in 246us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129005.853492:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789129005.854914:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626504704:0@lo:101: 00010000:00010000:3.0:1789129005.854940:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.854952:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129005.855030:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626504832:0@lo:501: 00000100:00100000:3.0:1789129005.855082:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129005.855120:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626504832 00000100:00100000:3.0:1789129005.855125:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626504832 00000100:00100000:3.0:1789129005.855163:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789129005.855171:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626504832:12345-0@lo:501: 00000100:00100000:3.0:1789129005.857788:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626504832:12345-0@lo:501: Request processed in 2604us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129005.857805:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789129005.857883:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129005.857920:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626504832:0@lo:501: 00000100:00100000:3.0:1789129005.857977:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626504960:0@lo:503: 00000100:00100000:3.0:1789129005.858037:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129005.858070:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129005.858665:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626504960 00000100:00100000:1.0:1789129005.858683:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626504960 00000100:00100000:1.0:1789129005.858733:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789129005.858743:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626504960:12345-0@lo:503: 00000100:00100000:1.0:1789129005.859147:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626504960:12345-0@lo:503: Request processed in 404us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129005.859155:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789129005.877451:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626504960:0@lo:503: 00000100:00100000:0.0:1789129005.878596:0:6870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6870:1876037626505088:0@lo:502: 00000100:00100000:0.0:1789129005.878741:0:6870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129005.878790:0:6870:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49013b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789129005.878937:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626505088 00000100:00100000:3.0:1789129005.878946:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626505088 00000100:00100000:3.0:1789129005.878999:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789129005.879009:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6870:x1876037626505088:12345-0@lo:502: 00000100:00100000:3.0:1789129005.879527:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6870:x1876037626505088:12345-0@lo:502: Request processed in 518us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129005.879535:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789129005.880454:0:6870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6870:1876037626505088:0@lo:502: 00000100:00100000:0.0:1789129005.880536:0:6870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6870:1876037626505216:0@lo:502: 00000100:00100000:0.0:1789129005.880791:0:6870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129005.880854:0:6870:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49013b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789129005.880915:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626505216 00000100:00100000:3.0:1789129005.880922:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626505216 00000100:00100000:3.0:1789129005.880972:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789129005.880982:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6870:x1876037626505216:12345-0@lo:502: 00000100:00100000:3.0:1789129005.881234:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:6870:x1876037626505216:12345-0@lo:502: Request processed in 252us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129005.881242:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789129005.881426:0:6870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6870:1876037626505216:0@lo:502: 00000040:00080000:0.0:1789129005.881456:0:6870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789129005.882087:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789129005.882115:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789129005.882129:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.882143:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129005.882172:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789129005.882175:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b4921dd800 from 4 10000000:01000000:3.0:1789129005.882178:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789129005.882219:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.882227:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.882236:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129005.882257:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626505344:0@lo:101: 00000100:00100000:3.0:1789129005.882973:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129005.883026:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789129005.883292:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626505344 00000100:00100000:0.0:1789129005.883316:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626505344 00000100:00100000:0.0:1789129005.883377:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789129005.883389:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626505344:12345-0@lo:101: 00010000:00010000:0.0:1789129005.883422:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129005.883448:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b480031c00/0x5c74554e47ce4117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4110 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.883480:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b480031c00/0x5c74554e47ce4117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4110 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.883494:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b480031c00/0x5c74554e47ce4117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4110 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.883507:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031c00, rc 0) 00000100:00100000:0.0:1789129005.883562:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626505344:12345-0@lo:101: Request processed in 176us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129005.883569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789129005.887122:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626505344:0@lo:101: 00010000:00010000:3.0:1789129005.887159:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.887173:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129005.887263:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626505472:0@lo:256: 00000100:00100000:3.0:1789129005.887345:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129005.887396:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789129005.887523:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626505472 00000100:00100000:0.0:1789129005.887531:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626505472 00000100:00100000:0.0:1789129005.887587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789129005.887597:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626505472:12345-0@lo:256: 20000000:01000000:0.0:1789129005.887652:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789129005.887679:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789129005.887682:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789129005.887768:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626505472:12345-0@lo:256: Request processed in 173us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129005.887776:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789129005.889269:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626505472:0@lo:256: 10000000:01000000:3.0:1789129005.889359:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789129005.889377:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.889387:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129005.889399:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789129005.889402:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789129005.889405:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789129005.889451:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.889459:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.889466:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129005.889485:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626505600:0@lo:101: 00000100:00100000:3.0:1789129005.889538:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129005.889581:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789129005.889811:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626505600 00000100:00100000:0.0:1789129005.889818:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626505600 00000100:00100000:0.0:1789129005.889860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789129005.889869:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626505600:12345-0@lo:101: 00010000:00010000:0.0:1789129005.889882:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129005.889902:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b480031a00/0x5c74554e47ce4125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce411e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.889927:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b480031a00/0x5c74554e47ce4125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce411e expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.889937:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b480031a00/0x5c74554e47ce4125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce411e expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.889945:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031a00, rc 0) 00000100:00100000:0.0:1789129005.889983:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626505600:12345-0@lo:101: Request processed in 115us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129005.889990:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789129005.890074:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626505600:0@lo:101: 00010000:00010000:3.0:1789129005.890086:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129005.890094:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129005.890145:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626505728:0@lo:501: 00000100:00100000:3.0:1789129005.890182:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129005.890210:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789129005.890258:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626505728 00000100:00100000:0.0:1789129005.890262:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626505728 00000100:00100000:0.0:1789129005.890303:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789129005.890310:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626505728:12345-0@lo:501: 00000100:00100000:0.0:1789129005.890779:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626505728:12345-0@lo:501: Request processed in 467us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129005.890787:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789129005.891466:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626505728:0@lo:501: 00000100:00100000:3.0:1789129005.891520:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626505856:0@lo:503: 00000100:00100000:3.0:1789129005.891579:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129005.891655:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789129005.893805:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626505856 00000100:00100000:0.0:1789129005.893821:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626505856 00000100:00100000:0.0:1789129005.893870:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789129005.893879:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626505856:12345-0@lo:503: 00000100:00100000:0.0:1789129005.896476:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626505856:12345-0@lo:503: Request processed in 2591us (4888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129005.896492:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789129005.902969:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626505856:0@lo:503: 00000100:00100000:2.0:1789129005.906042:0:6871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6871:1876037626505984:0@lo:502: 00000100:00100000:2.0:1789129005.906135:0:6871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129005.906184:0:6871:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129005.906233:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626505984 00000100:00100000:0.0:1789129005.906240:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626505984 00000100:00100000:0.0:1789129005.906308:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789129005.906318:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:6871:x1876037626505984:12345-0@lo:502: 00000100:00100000:0.0:1789129005.906697:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:6871:x1876037626505984:12345-0@lo:502: Request processed in 379us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129005.906705:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789129005.907424:0:6871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6871:1876037626505984:0@lo:502: 00000020:01000000:2.0:1789129005.907474:0:6871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789129005.907485:0:6871:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789129005.907494:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129005.907497:0:6871:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789129005.907503:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789129005.907507:0:6871:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:2.0:1789129005.907535:0:6871:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789129005.907538:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789129005.907568:0:6871:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90b4b5760000) 00000020:00000080:2.0:1789129005.907593:0:6871:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789129005.907628:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789129005.907733:0:6871:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789129005.907739:0:6871:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789129005.907747:0:6871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce4133 00010000:00080000:2.0:1789129005.907785:0:6871:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b485d0a000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:2.0:1789129005.908032:0:6871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789129005.971156:0:6871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789129005.971208:0:6871:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789129005.977306:0:6871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789129005.977549:0:6871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789129005.977655:0:6871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789129005.977736:0:6871:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789129005.979010:0:6873:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789129005.979016:0:6873:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789129005.980571:0:6871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789129005.980587:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789129005.981052:0:6871:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789129005.981086:0:6871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce413a 00000100:00080000:2.0:1789129005.981101:0:6871:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789129005.981107:0:6871:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90b485d0a000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1789129005.981148:0:6871:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b497af3480 x1876037626506112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789129005.981234:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626506112:0@lo:8: 00000100:00100000:1.0:1789129005.981337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129005.981546:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626506112 00000100:00100000:3.0:1789129005.981558:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626506112 00000100:00100000:3.0:1789129005.981649:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789129005.981659:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876037626506112:12345-0@lo:8: 00010000:00080000:3.0:1789129005.981712:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:3.0:1789129005.981754:0:6686:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce4141 00002000:00100000:3.0:1789129005.981800:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90b3812fe000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789129005.981805:0:6686:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789129005.981809:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789129005.981982:0:6686:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789129005.982153:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789129005.982190:0:6686:0:(import.c:65:import_set_state_nolock()) ffff90b3812ff000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789129005.982653:0:6871:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789129005.982946:0:6871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129005.982956:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129005.982959:0:6871:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789129005.982965:0:6871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129005.982969:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129005.982970:0:6871:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789129005.982973:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789129005.982976:0:6871:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789129005.983027:0:6871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6871:1876037626506240:0@lo:502: 00000100:00100000:2.0:1789129005.983105:0:6871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129005.983155:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626506240 00000100:00100000:2.0:1789129005.983162:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626506240 00000100:00100000:2.0:1789129005.983522:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789129005.983534:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:6871:x1876037626506240:12345-0@lo:502: 00000100:00100000:2.0:1789129005.984282:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:6871:x1876037626506240:12345-0@lo:502: Request processed in 746us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129005.984291:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789129005.984712:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626506496:0@lo:400: 00000100:00100000:0.0:1789129005.984773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129005.985290:0:6871:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac296c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129005.985394:0:6871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:6871:1876037626506240:0@lo:502: 00000020:01000000:2.0:1789129005.985427:0:6871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129005.985434:0:6871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129005.985437:0:6871:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789129005.985442:0:6871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789129005.986441:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789129005.986485:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789129005.986500:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.986514:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129005.986526:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789129005.986530:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90b487c73490 from 1 10000000:01000000:0.0:1789129005.986533:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789129005.986583:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.986593:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.986814:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129005.986840:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626506624:0@lo:101: 00000100:00100000:0.0:1789129005.987375:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129005.987445:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4857cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129005.987588:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626506368:0@lo:400: 00000100:00100000:1.0:1789129005.987684:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129005.987942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626506496 00000100:00100000:1.0:1789129005.987950:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626506496 00000100:00100000:1.0:1789129005.988001:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626506368 00000100:00100000:1.0:1789129005.988005:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626506368 00000100:00100000:1.0:1789129005.988030:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789129005.988040:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626506496:12345-0@lo:400: 00000100:00100000:1.0:1789129005.988103:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626506496:12345-0@lo:400: Request processed in 64us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129005.988111:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789129005.988128:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789129005.988144:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626506368:12345-0@lo:400: 00000100:00100000:1.0:1789129005.988180:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626506368:12345-0@lo:400: Request processed in 37us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129005.988186:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789129005.988225:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b22d00 x1876037626506368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129005.988239:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626506368:0@lo:400: 00010000:00080000:1.0:1789129005.988280:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b20b40 x1876037626506496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129005.988291:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626506496:0@lo:400: 00000100:00100000:2.0:1789129005.988586:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626506624 00000100:00100000:2.0:1789129005.988592:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626506624 00000100:00100000:2.0:1789129005.988829:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789129005.988837:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626506624:12345-0@lo:101: 00010000:00010000:2.0:1789129005.988848:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129005.988867:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b86000/0x5c74554e47ce414f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4148 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129005.988889:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b86000/0x5c74554e47ce414f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4148 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129005.988899:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b86000/0x5c74554e47ce414f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4148 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129005.988907:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86000, rc 0) 00000100:00100000:2.0:1789129005.989318:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626506624:12345-0@lo:101: Request processed in 481us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129005.989325:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789129005.989471:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876037626506112:12345-0@lo:8: Request processed in 7810us (8132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129005.989482:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789129005.989566:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626506624:0@lo:101: 00010000:00010000:0.0:1789129005.989584:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.989594:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129005.989702:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626506752:0@lo:501: 00000100:00100000:0.0:1789129005.989923:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129005.989955:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4857cc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129005.991576:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626506752 00000100:00100000:2.0:1789129005.991638:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626506752 00000100:00100000:2.0:1789129005.991713:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789129005.992379:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626506752:12345-0@lo:501: 00000100:00100000:2.0:1789129005.992946:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626506752:12345-0@lo:501: Request processed in 1222us (3031us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789129005.992956:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789129005.993238:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626506752:0@lo:501: 10000000:01000000:0.0:1789129005.993277:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789129005.993286:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129005.993369:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789129005.994431:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b497af3480 x1876037626506112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789129015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129005.994443:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789129005.994453:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789129005.994461:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789129005.994467:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789129005.994470:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d0a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789129005.994550:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789129005.994557:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626506112:0@lo:8: 00000004:00080000:3.0:1789129006.003203:0:6873:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789129006.003579:0:6873:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 169100975275ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789129006.110817:0:6874:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789129006.110847:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1876037626507008:0@lo:7: 00000100:00100000:1.0:1789129006.110931:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129006.110989:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015780 going to sleep for 11 seconds 00000100:00100000:1.0:1789129006.111033:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626506880:0@lo:13: 00000100:00100000:1.0:1789129006.111071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129006.111123:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626507008 00000100:00100000:1.0:1789129006.111130:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626507008 00000100:00100000:1.0:1789129006.111183:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789129006.111192:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6874:x1876037626507008:12345-0@lo:7: 00000100:00100000:2.0:1789129006.114361:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626506880 00000100:00100000:2.0:1789129006.114376:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626506880 00000100:00100000:2.0:1789129006.114432:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789129006.114441:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626506880:12345-0@lo:13: 00002000:00000024:2.0:1789129006.114478:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789129006.114562:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626506880:12345-0@lo:13: Request processed in 121us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129006.114569:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789129006.121004:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129006.123528:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498ac6d00 x1876037626506880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129006.123565:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626506880:0@lo:13: 00002000:00080000:0.0:1789129006.126463:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789129006.126475:0:6689:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789129006.126588:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6874:x1876037626507008:12345-0@lo:7: Request processed in 15392us (15651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129006.126631:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789129006.127763:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498ac4780 x1876037626507008/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789129022 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129006.127781:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1876037626507008:0@lo:7: 00000004:00080000:1.0:1789129006.127798:0:6874:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789129006.127838:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1876037626507136:0@lo:5: 00000100:00100000:1.0:1789129006.127891:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129006.127928:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015780 going to sleep for 11 seconds 00000100:00100000:2.0:1789129006.128116:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626507136 00000100:00100000:2.0:1789129006.128124:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626507136 00000100:00100000:2.0:1789129006.128181:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789129006.128192:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6874:x1876037626507136:12345-0@lo:5: 00002000:00080000:2.0:1789129006.128226:0:6686:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789129006.128231:0:6686:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789129006.128687:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6874:x1876037626507136:12345-0@lo:5: Request processed in 496us (795us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789129006.128697:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789129006.129824:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498ac4780 x1876037626507136/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789129022 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129006.129844:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1876037626507136:0@lo:5: 00000004:00080000:1.0:1789129006.129860:0:6874:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789129006.129915:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1876037626507264:0@lo:700: 00000100:00100000:1.0:1789129006.129972:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129006.130003:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015780 going to sleep for 11 seconds 00000100:00100000:1.0:1789129006.130034:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626507264 00000100:00100000:1.0:1789129006.130041:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626507264 00000100:00100000:1.0:1789129006.130099:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789129006.130109:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6874:x1876037626507264:12345-0@lo:700: 00000100:00100000:1.0:1789129006.130150:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1876037626507392:0@lo:700: 00000100:00100000:1.0:1789129006.130181:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129006.130198:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015480 going to sleep for 11 seconds 00000100:00100000:1.0:1789129006.130221:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626507392 00000100:00100000:1.0:1789129006.130224:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626507392 00000100:00100000:1.0:1789129006.130270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789129006.130278:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1876037626507392:12345-0@lo:700: 00000004:00080000:2.0:1789129006.156860:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1789129006.224050:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1789129006.231126:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789129006.249322:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1876037626507392:12345-0@lo:700: Request processed in 119025us (119121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129006.249360:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789129006.249391:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498ac6940 x1876037626507392/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789129022 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129006.249417:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1876037626507392:0@lo:700: 40000000:02000000:0.0:1789129006.249456:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1789129006.407670:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789129006.407699:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789129006.408138:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6874:x1876037626507264:12345-0@lo:700: Request processed in 278023us (278158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129006.408153:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789129006.408224:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498ac52c0 x1876037626507264/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789129022 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129006.408236:0:6874:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789129006.408255:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1876037626507264:0@lo:700: 00000004:02000040:0.0:1789129006.485880:0:6874:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789129006.488960:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1876037626507520:0@lo:5: 00000100:00100000:0.0:1789129006.489069:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129006.489156:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789129006.493091:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626507520 00000100:00100000:1.0:1789129006.493121:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626507520 00000100:00100000:1.0:1789129006.493248:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789129006.493262:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6874:x1876037626507520:12345-0@lo:5: 00002000:00080000:1.0:1789129006.505818:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789129006.505849:0:6689:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789129006.509569:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6874:x1876037626507520:12345-0@lo:5: Request processed in 16298us (20487us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789129006.509588:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789129006.509886:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b20780 x1876037626507520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789129022 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129006.509909:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1876037626507520:0@lo:5: 00000004:00080000:2.0:1789129006.509929:0:6874:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789129007.242186:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129008.261832:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129009.286905:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789129010.074029:0:7058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789129010.309817:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129011.333779:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129011.463223:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626507648:0@lo:13: 00000100:00100000:1.0:1789129011.463326:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129011.463520:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626507648 00000100:00100000:2.0:1789129011.463530:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626507648 00000100:00100000:2.0:1789129011.463636:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789129011.463650:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626507648:12345-0@lo:13: 00002000:00000024:2.0:1789129011.463696:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129011.463766:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626507776:0@lo:400: 00000100:00100000:0.0:1789129011.463805:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129011.464134:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626507648:12345-0@lo:13: Request processed in 487us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129011.464143:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789129011.464177:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129011.464416:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626507904:0@lo:400: 00000100:00100000:3.0:1789129011.464462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129011.464533:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626507904 00000100:00100000:3.0:1789129011.464539:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626507904 00000100:00100000:3.0:1789129011.464630:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789129011.464639:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626507904:12345-0@lo:400: 00000100:00100000:2.0:1789129011.464754:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626507776 00000100:00100000:2.0:1789129011.464759:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626507776 00000100:00100000:2.0:1789129011.464788:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789129011.464795:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3309:x1876037626507776:12345-0@lo:400: 00010000:00080000:1.0:1789129011.464873:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b497af2580 x1876037626507648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129011.464899:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626507648:0@lo:13: 00000100:00100000:2.0:1789129011.465523:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3309:x1876037626507776:12345-0@lo:400: Request processed in 725us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129011.465532:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789129011.465597:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626507776:0@lo:400: 00000100:00100000:3.0:1789129011.465988:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626507904:12345-0@lo:400: Request processed in 1348us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129011.465998:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789129011.466310:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498ae4780 x1876037626507904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129011.466323:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626507904:0@lo:400: 00000100:00100000:0.0:1789129011.466408:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626508032:0@lo:400: 00000100:00100000:0.0:1789129011.466465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129011.468800:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626508032 00000100:00100000:0.0:1789129011.468826:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626508032 00000100:00100000:0.0:1789129011.469094:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789129011.469110:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626508032:12345-0@lo:400: 00000100:00100000:0.0:1789129011.469224:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626508032:12345-0@lo:400: Request processed in 119us (2758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129011.469231:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789129011.469260:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789129011.469301:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498ae4780 x1876037626508032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129011.469317:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626508032:0@lo:400: 00000001:00080000:1.0:1789129011.572402:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789129012.358025:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129013.384480:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129014.407704:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129015.433033:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129016.455503:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129016.583120:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626508288:0@lo:400: 00000100:00100000:0.0:1789129016.583207:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129016.583279:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129016.583293:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626508160:0@lo:400: 00000100:00100000:0.0:1789129016.583328:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129016.583362:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626508416:0@lo:400: 00000100:00100000:0.0:1789129016.583391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129016.583413:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129016.583419:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626508544:0@lo:400: 00000100:00100000:1.0:1789129016.585275:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626508288 00000100:00100000:1.0:1789129016.585300:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626508288 00000100:00100000:1.0:1789129016.585364:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626508416 00000100:00100000:1.0:1789129016.585368:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626508416 00000100:00100000:1.0:1789129016.585425:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789129016.585438:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626508288:12345-0@lo:400: 00000100:00100000:1.0:1789129016.585572:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626508288:12345-0@lo:400: Request processed in 137us (2365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129016.585581:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789129016.585613:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789129016.585620:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626508416:12345-0@lo:400: 00000100:00100000:0.0:1789129016.585650:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129016.585701:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626508160 00000100:00100000:0.0:1789129016.585706:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626508160 00000100:00100000:0.0:1789129016.585738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789129016.585745:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3309:x1876037626508160:12345-0@lo:400: 00000100:00100000:0.0:1789129016.585778:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3309:x1876037626508160:12345-0@lo:400: Request processed in 34us (2449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129016.585784:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789129016.585820:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626508544 00000100:00100000:0.0:1789129016.585824:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626508544 00000100:00100000:0.0:1789129016.585851:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789129016.585858:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626508544:12345-0@lo:400: 00000100:00100000:1.0:1789129016.585891:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626508416:12345-0@lo:400: Request processed in 271us (2498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129016.585891:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626508544:12345-0@lo:400: Request processed in 33us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129016.585897:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789129016.585897:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789129016.585926:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789129016.585931:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789129016.586070:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b21e00 x1876037626508544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129016.586082:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789129016.586127:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626508544:0@lo:400: 00010000:00080000:1.0:1789129016.586143:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b22940 x1876037626508416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129016.586152:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626508416:0@lo:400: 00000100:00100000:1.0:1789129016.586293:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626508160:0@lo:400: 00010000:00080000:1.0:1789129016.586307:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b22580 x1876037626508288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129016.586315:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626508288:0@lo:400: 00000100:00100000:1.0:1789129016.591326:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626508672:0@lo:13: 00000100:00100000:1.0:1789129016.592530:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129016.594468:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626508672 00000100:00100000:2.0:1789129016.594496:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626508672 00000100:00100000:2.0:1789129016.594572:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789129016.594585:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626508672:12345-0@lo:13: 00002000:00000024:2.0:1789129016.594668:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129016.594806:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626508672:12345-0@lo:13: Request processed in 223us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129016.594814:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789129016.595765:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b497af2580 x1876037626508672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129016.595796:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626508672:0@lo:13: 00010000:00010000:3.0:1789129017.506394:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129018.577429:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129019.592535:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129020.615671:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129021.642788:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129021.702353:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626508800:0@lo:400: 00000100:00100000:1.0:1789129021.702451:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129021.702517:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789129021.702523:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626509184:0@lo:400: 00000100:00100000:1.0:1789129021.702554:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129021.702589:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626508928:0@lo:400: 00000100:00100000:1.0:1789129021.702637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129021.702660:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789129021.702667:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626509056:0@lo:400: 00000100:00100000:1.0:1789129021.705907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129021.706028:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626508928 00000100:00100000:1.0:1789129021.706039:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626508928 00000100:00100000:1.0:1789129021.706088:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626509056 00000100:00100000:1.0:1789129021.706092:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626509056 00000100:00100000:1.0:1789129021.706123:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789129021.706133:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626508928:12345-0@lo:400: 00000100:00100000:1.0:1789129021.706202:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626508928:12345-0@lo:400: Request processed in 71us (3564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129021.706210:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789129021.706229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789129021.706235:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626509056:12345-0@lo:400: 00000100:00100000:1.0:1789129021.706263:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626509056:12345-0@lo:400: Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129021.706268:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789129021.706313:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789129021.706597:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b230c0 x1876037626509056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129021.706634:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626509056:0@lo:400: 00010000:00080000:1.0:1789129021.706650:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b22580 x1876037626508928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129021.706659:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626508928:0@lo:400: 00000100:00100000:2.0:1789129021.710634:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626508800 00000100:00100000:2.0:1789129021.710943:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626508800 00000100:00100000:2.0:1789129021.711012:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789129021.711024:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3309:x1876037626508800:12345-0@lo:400: 00000100:00100000:2.0:1789129021.711123:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3309:x1876037626508800:12345-0@lo:400: Request processed in 102us (8673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129021.711130:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789129021.711170:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626509184 00000100:00100000:2.0:1789129021.711174:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626509184 00000100:00100000:2.0:1789129021.711208:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789129021.711214:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626509184:12345-0@lo:400: 00000100:00100000:2.0:1789129021.711245:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626509184:12345-0@lo:400: Request processed in 31us (8690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129021.711251:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789129021.713814:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626509312:0@lo:13: 00000100:00100000:0.0:1789129021.714952:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789129021.715033:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b22940 x1876037626509184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129021.715052:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626509184:0@lo:400: 00000100:00100000:0.0:1789129021.715081:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626508800:0@lo:400: 00000100:00080000:2.0:1789129021.717775:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129021.717816:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626509312 00000100:00100000:2.0:1789129021.717832:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626509312 00000100:00100000:2.0:1789129021.717911:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789129021.717925:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626509312:12345-0@lo:13: 00002000:00000024:2.0:1789129021.717983:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129021.718107:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626509312:12345-0@lo:13: Request processed in 184us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129021.718117:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789129021.718199:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b497af3480 x1876037626509312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129021.718242:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626509312:0@lo:13: 00010000:00010000:2.0:1789129022.663154:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789129023.279413:0:7619:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789129023.279418:0:7619:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789129023.279564:0:7619:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90b3812fb000 00000020:01000004:3.0:1789129023.279580:0:7619:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789129023.279594:0:7619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789129023.279655:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90b4bb021a48) 00000020:00000080:3.0:1789129023.279671:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789129023.304289:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789129023.304897:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789129023.357599:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789129023.367194:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789129023.367236:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789129023.367296:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789129023.367406:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789129023.368249:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789129023.368264:0:7619:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789129023.368276:0:7619:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5c74554e47ce415d 00000020:01000004:2.0:1789129023.368286:0:7619:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789129023.368310:0:7619:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789129023.368325:0:7619:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789129023.368332:0:7619:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789129023.368364:0:7619:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789129023.368369:0:7619:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789129023.404859:0:7619:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789129023.404903:0:7619:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.139@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789129023.404907:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789129023.404909:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789129023.404914:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129023.404915:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129023.404916:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129023.404917:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129023.404919:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789129023.404920:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789129023.404921:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789129023.404923:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129023.404924:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789129023.404929:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789129023.404931:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789129023.404932:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789129023.404933:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129023.404934:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129023.404935:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129023.404936:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129023.404937:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789129023.404938:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789129023.404939:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789129023.404940:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129023.404941:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789129023.404979:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789129023.405005:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626509440:0@lo:253: 00000100:00100000:3.0:1789129023.405107:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129023.405225:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584840 going to sleep for 11 seconds 00000100:00100000:0.0:1789129023.408889:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626509440 00000100:00100000:0.0:1789129023.408914:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626509440 00000100:00100000:1.0:1789129023.409257:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789129023.409270:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:7619:x1876037626509440:12345-0@lo:253: 20000000:01000000:1.0:1789129023.409344:0:5834:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789129023.409367:0:5834:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789129023.409373:0:5834:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789129023.409377:0:5834:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789129023.412834:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789129023.413090:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789129023.413105:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789129023.413145:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789129023.413152:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789129023.413176:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789129023.413216:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789129023.414245:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789129023.414265:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.139@tcp 20000000:01000000:1.0:1789129023.414268:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.139@tcp (null) (null) (null) 00000040:00080000:1.0:1789129023.414484:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789129023.414493:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789129023.414759:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789129023.414768:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.139@tcp (null) (null) 00000040:00080000:1.0:1789129023.414800:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789129023.414808:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789129023.414837:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789129023.414879:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789129023.416251:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789129023.416275:0:5834:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.139@tcp 20000000:01000000:1.0:1789129023.416277:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.139@tcp (null) (null) (null) 00000040:00080000:1.0:1789129023.416319:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789129023.416327:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789129023.416353:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789129023.416370:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.139@tcp (null) (null) 00000040:00080000:1.0:1789129023.416400:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789129023.416408:0:5834:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789129023.416450:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789129023.416487:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789129023.416524:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789129023.416528:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789129023.416535:0:5834:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789129023.416537:0:5834:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789129023.416539:0:5834:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789129023.416565:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789129023.416568:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789129023.416648:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789129023.416651:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789129023.418932:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1789129023.419037:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1789129023.419088:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789129023.419484:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789129023.419566:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789129023.420028:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789129023.420063:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789129023.420067:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789129023.421225:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789129023.422108:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789129023.422148:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789129023.422239:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789129023.422255:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789129023.422257:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789129023.424420:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789129023.424522:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789129023.424584:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789129023.425047:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789129023.425097:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789129023.425160:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789129023.425176:0:5834:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789129023.425179:0:5834:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789129023.428026:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789129023.428148:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789129023.428180:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789129023.435912:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789129023.435978:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789129023.436052:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1789129023.436076:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789129023.436102:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.436122:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b48151b200/0x5c74554e47ce40b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce40ae expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.436132:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b481656200/0x5c74554e47ce40df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce40d8 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.436139:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b480031800/0x5c74554e47ce4109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4102 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.436146:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b480031a00/0x5c74554e47ce4125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce411e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.436153:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b489b86000/0x5c74554e47ce414f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4148 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.436183:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.436235:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b489b86000/0x5c74554e47ce414f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4148 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.436256:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b489b86000/0x5c74554e47ce414f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4148 expref: 16 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.436273:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b50b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626509568:0@lo:104: 00000100:00100000:1.0:1789129023.436871:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789129023.436932:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b480031a00/0x5c74554e47ce4125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce411e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.436944:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b480031a00/0x5c74554e47ce4125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce411e expref: 16 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.436954:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b530c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626509696:0@lo:104: 00010000:00010000:1.0:1789129023.436982:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b480031800/0x5c74554e47ce4109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4102 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.436989:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b480031800/0x5c74554e47ce4109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4102 expref: 16 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.436997:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b50000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626509824:0@lo:104: 00010000:00010000:1.0:1789129023.437021:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b481656200/0x5c74554e47ce40df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce40d8 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.437028:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b481656200/0x5c74554e47ce40df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce40d8 expref: 16 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.437046:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b53840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626509952:0@lo:104: 00010000:00010000:1.0:1789129023.437076:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b48151b200/0x5c74554e47ce40b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce40ae expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.437083:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b48151b200/0x5c74554e47ce40b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce40ae expref: 16 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.437091:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b521c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626510080:0@lo:104: 00000100:00100000:1.0:1789129023.437110:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d10000 going to sleep for 11 seconds 00000100:00100000:2.0:1789129023.437760:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789129023.437791:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.437822:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.437831:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.437841:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.437859:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626509568 00000100:00100000:2.0:1789129023.437866:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626509568 00000100:00100000:2.0:1789129023.437902:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626509696 00000100:00100000:2.0:1789129023.437906:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626509696 00000100:00100000:2.0:1789129023.437917:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626509824 00000100:00100000:2.0:1789129023.437919:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626509824 00000100:00100000:2.0:1789129023.437947:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626509952 00000100:00100000:2.0:1789129023.437951:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626509952 00000100:00100000:2.0:1789129023.437960:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626510080 00000100:00100000:2.0:1789129023.437962:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626510080 00000100:00100000:2.0:1789129023.437976:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789129023.437984:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485d42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+7:5834:x1876037626509568:12345-0@lo:104: 00010000:00010000:2.0:1789129023.437999:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438062:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789129023.438068:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485d42850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+7:5834:x1876037626509568:12345-0@lo:104: Request processed in 86us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129023.438076:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789129023.438134:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789129023.438141:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+6:5834:x1876037626509696:12345-0@lo:104: 00010000:00010000:2.0:1789129023.438149:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438182:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789129023.438187:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+6:5834:x1876037626509696:12345-0@lo:104: Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129023.438200:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789129023.438220:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789129023.438226:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:5834:x1876037626509824:12345-0@lo:104: 00010000:00010000:2.0:1789129023.438234:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438262:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789129023.438266:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:5834:x1876037626509824:12345-0@lo:104: Request processed in 42us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129023.438272:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789129023.438283:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789129023.438288:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:5834:x1876037626509952:12345-0@lo:104: 00010000:00010000:2.0:1789129023.438295:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438332:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789129023.438337:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:5834:x1876037626509952:12345-0@lo:104: Request processed in 49us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129023.438343:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789129023.438369:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789129023.438376:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:5834:x1876037626510080:12345-0@lo:104: 00010000:00010000:2.0:1789129023.438383:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438409:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789129023.438414:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:5834:x1876037626510080:12345-0@lo:104: Request processed in 40us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129023.438425:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789129023.438448:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789129023.438455:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438464:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031e00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129023.438470:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438480:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129023.438488:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129023.438495:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129023.438540:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438548:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129023.438567:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438575:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce4148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce414f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438590:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789129023.438594:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438648:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b800 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129023.438651:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438658:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129023.438665:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129023.438670:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129023.438685:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438691:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129023.438697:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438703:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce411e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4125 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438712:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789129023.438716:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438721:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151bc00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129023.438723:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438741:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129023.438748:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129023.438754:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129023.438767:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438772:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129023.438786:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438794:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151bc00/0x5c74554e47ce4102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4109 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438803:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789129023.438806:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438811:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030000 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129023.438814:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438821:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129023.438826:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129023.438838:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129023.438852:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438857:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129023.438863:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438869:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce40d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce40df expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438878:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129023.438881:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438887:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656400 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129023.438889:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438895:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129023.438900:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129023.438905:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129023.438915:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438921:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129023.438931:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438937:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b481656400/0x5c74554e47ce40ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce40b5 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.438953:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129023.438955:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129023.438956:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129023.438963:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129023.438976:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626510464:0@lo:103: 00000100:00100000:2.0:1789129023.439020:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.439055:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789129023.439061:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626510592:0@lo:103: 00000100:00100000:2.0:1789129023.439083:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.439118:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626510464 00000100:00100000:2.0:1789129023.439123:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626510464 00010000:00010000:2.0:1789129023.439143:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b480031800/0x5c74554e47ce4109 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4102 expref: 17 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129023.439165:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626510592 00000100:00100000:2.0:1789129023.439169:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626510592 00010000:00010000:2.0:1789129023.439179:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b481656200/0x5c74554e47ce40df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce40d8 expref: 18 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129023.439191:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789129023.439197:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:3308:x1876037626510464:12345-0@lo:103: 00010000:00010000:2.0:1789129023.439206:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129023.439212:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b480031800/0x5c74554e47ce4109 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4102 expref: 18 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.439231:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b480031800/0x5c74554e47ce4109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4102 expref: 18 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.439249:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129023.439276:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:3308:x1876037626510464:12345-0@lo:103: Request processed in 79us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129023.439282:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789129023.439295:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789129023.439301:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3308:x1876037626510592:12345-0@lo:103: 00010000:00010000:2.0:1789129023.439308:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129023.439313:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b481656200/0x5c74554e47ce40df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce40d8 expref: 17 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.439320:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b481656200/0x5c74554e47ce40df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce40d8 expref: 17 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.439329:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129023.439349:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3308:x1876037626510592:12345-0@lo:103: Request processed in 48us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129023.439367:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789129023.439403:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626510592:0@lo:103: 00000100:00100000:2.0:1789129023.439412:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626510464:0@lo:103: 00000100:00100000:0.0:1789129023.439627:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626510336:0@lo:103: 00000100:00100000:0.0:1789129023.439655:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.439678:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789129023.439683:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48a172d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626510208:0@lo:103: 00000100:00100000:0.0:1789129023.439701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.439718:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626510720:0@lo:103: 00000100:00100000:0.0:1789129023.439737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.439760:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626510336 00000100:00100000:0.0:1789129023.439763:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626510336 00010000:00010000:0.0:1789129023.439781:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b480031a00/0x5c74554e47ce4125 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce411e expref: 17 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129023.439794:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626510208 00000100:00100000:0.0:1789129023.439797:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626510208 00010000:00010000:0.0:1789129023.439808:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b489b86000/0x5c74554e47ce414f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4148 expref: 18 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129023.439819:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626510720 00000100:00100000:0.0:1789129023.439821:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626510720 00010000:00010000:0.0:1789129023.439830:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b48151b200/0x5c74554e47ce40b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce40ae expref: 19 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129023.439854:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789129023.439861:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626510336:12345-0@lo:103: 00010000:00010000:0.0:1789129023.439869:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129023.439873:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b480031a00/0x5c74554e47ce4125 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce411e expref: 19 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.439881:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b480031a00/0x5c74554e47ce4125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce411e expref: 19 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.439891:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129023.439918:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626510336:12345-0@lo:103: Request processed in 58us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.439924:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789129023.439936:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789129023.439943:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:3307:x1876037626510208:12345-0@lo:103: 00010000:00010000:0.0:1789129023.439949:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129023.439953:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b489b86000/0x5c74554e47ce414f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4148 expref: 18 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.439963:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b489b86000/0x5c74554e47ce414f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4148 expref: 18 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.439972:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129023.439993:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:3307:x1876037626510208:12345-0@lo:103: Request processed in 51us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.439999:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789129023.440011:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789129023.440026:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3307:x1876037626510720:12345-0@lo:103: 00010000:00010000:0.0:1789129023.440033:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129023.440039:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b48151b200/0x5c74554e47ce40b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce40ae expref: 17 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440047:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b48151b200/0x5c74554e47ce40b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce40ae expref: 17 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440059:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440067:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440081:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440088:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440095:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440102:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440107:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481657600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129023.440111:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440119:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440135:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.440145:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129023.440167:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3307:x1876037626510720:12345-0@lo:103: Request processed in 142us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.440173:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789129023.440290:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48a172d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626510208:0@lo:103: 00000100:00100000:0.0:1789129023.440298:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626510720:0@lo:103: 00000100:00100000:0.0:1789129023.440319:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626510336:0@lo:103: 00010000:00010000:1.0:1789129023.441524:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b86000/0x5c74554e47ce414f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4148 expref: 16 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.441543:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b50b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626509568:0@lo:104: 00010000:00010000:1.0:1789129023.441556:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480031a00/0x5c74554e47ce4125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce411e expref: 15 pid: 5835 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.441566:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b530c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626509696:0@lo:104: 00010000:00010000:1.0:1789129023.441576:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480031800/0x5c74554e47ce4109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4102 expref: 14 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.441588:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b50000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626509824:0@lo:104: 00010000:00010000:1.0:1789129023.441597:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656200/0x5c74554e47ce40df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce40d8 expref: 13 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.441630:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b53840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626509952:0@lo:104: 00010000:00010000:1.0:1789129023.441641:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151b200/0x5c74554e47ce40b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce40ae expref: 12 pid: 5833 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.441667:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b521c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5834:1876037626510080:0@lo:104: 00010000:00010000:1.0:1789129023.441708:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.441718:0:5834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.441723:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.441729:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481657600/0x5c74554e47ce4164 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789129023.441753:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789129023.502776:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:7619:x1876037626509440:12345-0@lo:253: Request processed in 93494us (97655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129023.502797:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789129023.502932:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626509440:0@lo:253: 10000000:01000000:1.0:1789129023.502951:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789129023.502954:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789129023.502956:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789129023.502958:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789129023.502959:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789129023.502960:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789129023.502962:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789129023.502963:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789129023.502965:0:7619:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789129023.502968:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789129023.502969:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789129023.502995:0:7619:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90b3812fb000 from lustre-OST0001 10000000:01000000:1.0:1789129023.503023:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789129023.503026:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789129023.503035:0:7619:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90b487c73490 local copy 10000000:01000000:1.0:1789129023.503039:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789129023.503093:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.503105:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.503115:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.503140:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b521c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626510848:0@lo:101: 00000100:00100000:1.0:1789129023.503193:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129023.503236:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d10900 going to sleep for 11 seconds 00000100:00100000:3.0:1789129023.503294:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626510848 00000100:00100000:3.0:1789129023.503302:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626510848 00000100:00100000:3.0:1789129023.503383:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789129023.503392:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+11:7619:x1876037626510848:12345-0@lo:101: 00010000:00010000:3.0:1789129023.503407:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129023.503422:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151ba00/0x5c74554e47ce4172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce416b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.503452:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151ba00/0x5c74554e47ce4172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce416b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.503465:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151ba00/0x5c74554e47ce4172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce416b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.503476:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151ba00, rc 0) 00000100:00100000:3.0:1789129023.503507:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626510848:12345-0@lo:101: Request processed in 117us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129023.503513:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789129023.503659:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b521c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626510848:0@lo:101: 00010000:00010000:1.0:1789129023.503672:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.503681:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.503782:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b521c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626510976:0@lo:501: 00000100:00100000:1.0:1789129023.503810:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129023.503836:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d10900 going to sleep for 11 seconds 00000100:00100000:3.0:1789129023.503889:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626510976 00000100:00100000:3.0:1789129023.503893:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626510976 00000100:00100000:3.0:1789129023.503926:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789129023.503933:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626510976:12345-0@lo:501: 00000100:00100000:3.0:1789129023.504164:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626510976:12345-0@lo:501: Request processed in 231us (352us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789129023.504172:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789129023.504205:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b521c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626510976:0@lo:501: 10000000:01000000:3.0:1789129023.504218:0:7619:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789129023.504244:0:7619:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789129023.504250:0:7619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.504268:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.504275:0:7619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.504290:0:7619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789129023.504385:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b3812fb000 10000000:01000000:3.0:1789129023.504391:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789129023.504396:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789129023.504398:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789129023.504402:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789129023.504405:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789129023.504422:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.504429:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.504435:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129023.504446:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511104:0@lo:101: 00000100:00100000:3.0:1789129023.504474:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129023.504487:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584000 going to sleep for 11 seconds 00010000:00010000:2.0:1789129023.504558:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129023.504568:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.504576:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481657600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129023.504589:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.504639:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129023.504648:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129023.504654:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129023.504675:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.504681:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129023.504699:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.504706:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b481657600/0x5c74554e47ce416b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5c74554e47ce4172 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.504729:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129023.504730:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129023.504732:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129023.505135:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789129023.505149:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626511232:0@lo:103: 00000100:00100000:1.0:1789129023.505183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129023.505234:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626511104 00000100:00100000:1.0:1789129023.505239:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626511104 00000100:00100000:1.0:1789129023.505269:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789129023.505278:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626511104:12345-0@lo:101: 00010000:00010000:1.0:1789129023.505298:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129023.505325:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b481656200/0x5c74554e47ce4180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4179 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.505347:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656200/0x5c74554e47ce4180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4179 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.505367:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b481656200/0x5c74554e47ce4180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4179 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.505377:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656200, rc 0) 00000100:00100000:1.0:1789129023.505410:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626511104:12345-0@lo:101: Request processed in 133us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.505417:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789129023.505575:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511104:0@lo:101: 00010000:00010000:3.0:1789129023.505587:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.505633:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129023.505729:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511360:0@lo:501: 00000100:00100000:3.0:1789129023.505765:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129023.505787:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584000 going to sleep for 11 seconds 00000100:00100000:1.0:1789129023.506023:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626511360 00000100:00100000:1.0:1789129023.506027:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626511360 00000100:00100000:1.0:1789129023.506061:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789129023.506067:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626511360:12345-0@lo:501: 00000100:00100000:1.0:1789129023.506319:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626511360:12345-0@lo:501: Request processed in 238us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.506327:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789129023.506477:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511360:0@lo:501: 00000100:00100000:3.0:1789129023.506507:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511488:0@lo:503: 00000100:00100000:3.0:1789129023.506549:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129023.506581:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584000 going to sleep for 11 seconds 00000100:00100000:2.0:1789129023.506690:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626511232 00000100:00100000:2.0:1789129023.506695:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626511232 00000100:00100000:2.0:1789129023.506732:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789129023.506740:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b53840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:3306:x1876037626511232:12345-0@lo:103: 00010000:00010000:2.0:1789129023.506751:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129023.506770:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151ba00/0x5c74554e47ce4172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce416b expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.506794:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129023.506826:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b53840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:3306:x1876037626511232:12345-0@lo:103: Request processed in 88us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129023.506833:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789129023.507052:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626511232:0@lo:103: 00000100:00100000:1.0:1789129023.507075:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626511488 00000100:00100000:1.0:1789129023.507079:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626511488 00000100:00100000:1.0:1789129023.507109:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789129023.507116:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626511488:12345-0@lo:503: 00000100:00100000:1.0:1789129023.507277:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626511488:12345-0@lo:503: Request processed in 160us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.507290:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789129023.507408:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511488:0@lo:503: 00000040:00080000:3.0:1789129023.507753:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789129023.507817:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511616:0@lo:502: 00000100:00100000:3.0:1789129023.507860:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129023.507898:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129023.508078:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626511616 00000100:00100000:0.0:1789129023.508083:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626511616 00000100:00100000:0.0:1789129023.508108:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789129023.508115:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626511616:12345-0@lo:502: 00000100:00100000:0.0:1789129023.508264:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626511616:12345-0@lo:502: Request processed in 148us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.508271:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789129023.508438:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511616:0@lo:502: 00000040:00080000:3.0:1789129023.508901:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789129023.508958:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789129023.508993:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789129023.509039:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789129023.509078:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789129023.509113:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789129023.509142:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511744:0@lo:502: 00000100:00100000:3.0:1789129023.509185:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129023.509221:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584000 going to sleep for 11 seconds 00000100:00100000:2.0:1789129023.509318:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626511744 00000100:00100000:2.0:1789129023.509323:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626511744 00000100:00100000:2.0:1789129023.509369:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789129023.509378:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626511744:12345-0@lo:502: 00000100:00100000:2.0:1789129023.509531:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626511744:12345-0@lo:502: Request processed in 154us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129023.509539:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789129023.509865:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511744:0@lo:502: 00000040:00080000:3.0:1789129023.509964:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789129023.509975:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789129023.516078:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789129023.516092:0:7628:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789129023.516099:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129023.516101:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789129023.516108:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789129023.516145:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90b4a785ced8) 00000020:00000080:0.0:1789129023.516171:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789129023.516178:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789129023.516243:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b3812fb000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789129023.516253:0:7628:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789129023.516270:0:7628:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5c74554e47ce418e 00010000:00010000:2.0:1789129023.523125:0:7628:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789129023.523575:0:7628:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789129023.528732:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789129023.529112:0:7628:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789129023.539938:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789129023.549733:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789129023.554768:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789129023.554786:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129023.554794:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129023.554796:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789129023.554799:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129023.554804:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129023.554805:0:7628:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789129023.554808:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789129023.554810:0:7628:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789129023.554864:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129023.554867:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129023.554869:0:7628:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789129023.554872:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789129023.562571:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789129023.562655:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789129023.562684:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.562700:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129023.562710:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b3812fb000 from 1 10000000:01000000:0.0:1789129023.562714:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789129023.562765:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.562774:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.562787:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129023.562816:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511872:0@lo:101: 00000100:00100000:0.0:1789129023.562899:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.562946:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015480 going to sleep for 11 seconds 00000100:00100000:3.0:1789129023.563191:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626511872 00000100:00100000:3.0:1789129023.563202:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626511872 00000100:00100000:3.0:1789129023.563294:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789129023.563314:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:7619:x1876037626511872:12345-0@lo:101: 00010000:00010000:3.0:1789129023.563329:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129023.563344:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151b000/0x5c74554e47ce419c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4195 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.563376:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151b000/0x5c74554e47ce419c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4195 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.563387:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151b000/0x5c74554e47ce419c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4195 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.563395:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b000, rc 0) 00000100:00100000:3.0:1789129023.563436:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626511872:12345-0@lo:101: Request processed in 132us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129023.563443:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789129023.565207:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626511872:0@lo:101: 00010000:00010000:0.0:1789129023.565237:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129023.565249:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129023.565439:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512000:0@lo:501: 00000100:00100000:0.0:1789129023.565506:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.565555:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015480 going to sleep for 11 seconds 00000100:00100000:1.0:1789129023.565790:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626512000 00000100:00100000:1.0:1789129023.565796:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626512000 00000100:00100000:1.0:1789129023.565839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789129023.565848:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626512000:12345-0@lo:501: 00000100:00100000:1.0:1789129023.566106:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626512000:12345-0@lo:501: Request processed in 258us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.566114:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789129023.566456:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512000:0@lo:501: 00000100:00100000:0.0:1789129023.567619:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512128:0@lo:503: 00000100:00100000:0.0:1789129023.567709:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.567749:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015480 going to sleep for 11 seconds 00000100:00100000:0.0:1789129023.567775:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626512128 00000100:00100000:0.0:1789129023.567781:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626512128 00000100:00100000:0.0:1789129023.567823:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789129023.567832:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626512128:12345-0@lo:503: 00000100:00100000:0.0:1789129023.570021:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626512128:12345-0@lo:503: Request processed in 2180us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.571457:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512128:0@lo:503: 00000040:00080000:1.0:1789129023.571920:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789129023.572394:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789129023.572566:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512256:0@lo:502: 00000100:00100000:1.0:1789129023.572717:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129023.572767:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485d10900 going to sleep for 11 seconds 00000100:00100000:0.0:1789129023.572987:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626512256 00000100:00100000:0.0:1789129023.572995:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626512256 00000100:00100000:0.0:1789129023.573103:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789129023.573116:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626512256:12345-0@lo:502: 00000100:00100000:0.0:1789129023.574212:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626512256:12345-0@lo:502: Request processed in 1082us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.574223:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789129023.576230:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512256:0@lo:502: 00000040:00080000:2.0:1789129023.579491:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789129023.580199:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789129023.580266:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512384:0@lo:502: 00000100:00100000:2.0:1789129023.580437:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.580536:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0a78840 going to sleep for 11 seconds 00000100:00100000:0.0:1789129023.580759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626512384 00000100:00100000:0.0:1789129023.580768:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626512384 00000100:00100000:0.0:1789129023.580951:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789129023.580962:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626512384:12345-0@lo:502: 00000100:00100000:0.0:1789129023.581584:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626512384:12345-0@lo:502: Request processed in 621us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.581594:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789129023.581842:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512384:0@lo:502: 00000040:00080000:2.0:1789129023.583045:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789129023.583069:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789129023.583846:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789129023.583858:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129023.583860:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789129023.583867:0:7632:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b3812fb000 00000020:00000080:3.0:1789129023.583870:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789129023.583891:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129023.583894:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129023.583902:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789129023.583905:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789129023.584255:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789129023.584278:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789129023.584313:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.584327:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129023.584382:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789129023.584385:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b3812fb000 10000000:01000000:2.0:1789129023.584389:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b3812fb000 10000000:01000000:2.0:1789129023.584392:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789129023.584398:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b3812fb000 from 1 10000000:01000000:2.0:1789129023.584401:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789129023.584440:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.584449:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.584459:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129023.584481:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512512:0@lo:101: 00000100:00100000:2.0:1789129023.584554:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.584638:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0a78180 going to sleep for 11 seconds 00000100:00100000:1.0:1789129023.584764:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626512512 00000100:00100000:1.0:1789129023.584773:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626512512 00000100:00100000:1.0:1789129023.584836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789129023.584846:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626512512:12345-0@lo:101: 00010000:00010000:1.0:1789129023.584861:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129023.584876:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b481656000/0x5c74554e47ce41aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce41a3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.584900:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656000/0x5c74554e47ce41aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce41a3 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.584911:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b481656000/0x5c74554e47ce41aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce41a3 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.584927:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656000, rc 0) 00000100:00100000:1.0:1789129023.584973:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:7619:x1876037626512512:12345-0@lo:101: Request processed in 129us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.584981:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789129023.586012:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512512:0@lo:101: 00010000:00010000:2.0:1789129023.586275:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.586288:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129023.586853:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512640:0@lo:501: 00000100:00100000:2.0:1789129023.586910:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.586991:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0a78180 going to sleep for 11 seconds 00000100:00100000:1.0:1789129023.587787:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626512640 00000100:00100000:1.0:1789129023.587883:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626512640 00000100:00100000:1.0:1789129023.588024:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789129023.588045:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:7619:x1876037626512640:12345-0@lo:501: 00000100:00100000:1.0:1789129023.588388:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:7619:x1876037626512640:12345-0@lo:501: Request processed in 346us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.588398:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789129023.588477:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512640:0@lo:501: 00000100:00100000:3.0:1789129023.588526:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512768:0@lo:503: 00000100:00100000:3.0:1789129023.588572:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129023.591467:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789129023.592528:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626512768 00000100:00100000:1.0:1789129023.592539:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626512768 00000100:00100000:1.0:1789129023.592589:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789129023.592620:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:7619:x1876037626512768:12345-0@lo:503: 00000100:00100000:1.0:1789129023.592890:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:7619:x1876037626512768:12345-0@lo:503: Request processed in 292us (4317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.592898:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789129023.593042:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512768:0@lo:503: 00000040:00080000:3.0:1789129023.593383:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789129023.593455:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512896:0@lo:502: 00000100:00100000:3.0:1789129023.593501:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129023.593538:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789129023.593880:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626512896 00000100:00100000:1.0:1789129023.593886:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626512896 00000100:00100000:1.0:1789129023.593911:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789129023.593918:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:7619:x1876037626512896:12345-0@lo:502: 00000100:00100000:1.0:1789129023.594122:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:7619:x1876037626512896:12345-0@lo:502: Request processed in 202us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.594130:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789129023.594271:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626512896:0@lo:502: 00000040:00080000:3.0:1789129023.594597:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789129023.594680:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789129023.594716:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789129023.594761:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789129023.594813:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789129023.594865:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789129023.594903:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789129023.594936:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789129023.594994:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789129023.595047:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789129023.595081:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789129023.595125:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789129023.595161:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789129023.595194:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789129023.595238:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789129023.595271:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789129023.595320:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789129023.595465:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789129023.595504:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789129023.595535:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789129023.595581:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789129023.595638:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789129023.595673:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789129023.595723:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789129023.595779:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789129023.595816:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789129023.595867:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789129023.595905:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789129023.595940:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789129023.595989:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789129023.596028:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789129023.596062:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789129023.596112:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789129023.596165:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789129023.596200:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789129023.596244:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789129023.596280:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789129023.596320:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626513024:0@lo:502: 00000100:00100000:3.0:1789129023.596401:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129023.596442:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789129023.597188:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626513024 00000100:00100000:1.0:1789129023.597210:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626513024 00000100:00100000:1.0:1789129023.597254:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789129023.597264:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:7619:x1876037626513024:12345-0@lo:502: 00000100:00100000:1.0:1789129023.597565:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:7619:x1876037626513024:12345-0@lo:502: Request processed in 301us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.597574:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789129023.600735:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626513024:0@lo:502: 00000040:00080000:3.0:1789129023.600910:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789129023.600938:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789129023.605244:0:7633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789129023.605279:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90b3824e0000) 00000020:00000080:3.0:1789129023.605370:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789129023.605443:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b3812fb000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789129023.605447:0:7633:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b3812fb000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789129023.605455:0:7633:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b3812fb000 3 00010000:00080000:3.0:1789129023.605485:0:7633:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b4a7802800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.139@tcp at head 00010000:00010000:3.0:1789129023.608800:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789129023.609046:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789129023.609084:0:7633:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789129023.609097:0:7633:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5c74554e47ce41b8 00000100:00080000:3.0:1789129023.609107:0:7633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789129023.609112:0:7633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90b4a7802800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789129023.609148:0:7633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b498ae7840 x1876037626513152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789129023.609178:0:7633:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789129023.609429:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626513152:0@lo:38: 00000100:00100000:2.0:1789129023.609510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.609729:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626513408:0@lo:400: 00000100:00100000:0.0:1789129023.609785:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.609813:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129023.609819:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626513280:0@lo:400: 00000100:00100000:0.0:1789129023.609844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.609870:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48a172d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626513536:0@lo:400: 00000100:00100000:0.0:1789129023.609897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.609943:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626513152 00000100:00100000:0.0:1789129023.609950:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626513152 00000100:00100000:0.0:1789129023.609977:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626513408 00000100:00100000:0.0:1789129023.609980:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626513408 00000100:00100000:0.0:1789129023.610011:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626513280 00000100:00100000:0.0:1789129023.610014:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626513280 00000100:00100000:0.0:1789129023.610029:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789129023.610037:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3821030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626513408:12345-0@lo:400: 00000100:00100000:0.0:1789129023.610088:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3821030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626513408:12345-0@lo:400: Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.610095:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789129023.610107:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789129023.610113:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626513280:12345-0@lo:400: 00000100:00100000:0.0:1789129023.610158:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382100000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626513280:12345-0@lo:400: Request processed in 44us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.610164:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789129023.610176:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789129023.610187:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1876037626513152:12345-0@lo:38: 00010000:00080000:0.0:1789129023.610210:0:6710:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:0.0:1789129023.610240:0:6710:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5c74554e47ce41bf 00000004:00100000:0.0:1789129023.610256:0:6710:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789129023.610288:0:6710:0:(import.c:65:import_set_state_nolock()) ffff90b4c094e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789129023.610491:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876037626513152:12345-0@lo:38: Request processed in 302us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.610498:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789129023.610525:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626513536 00000100:00100000:0.0:1789129023.610530:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626513536 00000100:00100000:0.0:1789129023.610559:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789129023.610567:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382103840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626513536:12345-0@lo:400: 00000100:00100000:0.0:1789129023.610630:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382103840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626513536:12345-0@lo:400: Request processed in 37us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.610637:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789129023.610659:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789129023.610663:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789129023.610861:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b48a172d00 x1876037626513536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129023.610877:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48a172d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626513536:0@lo:400: 00010000:00080000:0.0:1789129023.610907:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b230c0 x1876037626513280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129023.610917:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626513280:0@lo:400: 00010000:00080000:0.0:1789129023.610986:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498b22580 x1876037626513408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129023.610995:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626513408:0@lo:400: 00010000:00080000:0.0:1789129023.611044:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b498ae7840 x1876037626513152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789129033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129023.611052:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789129023.611058:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789129023.611064:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789129023.611068:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789129023.611071:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4a7802800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789129023.611076:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626513152:0@lo:38: 00000040:00080000:3.0:1789129023.615887:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789129023.616088:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789129023.616121:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789129023.616146:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.616159:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789129023.616206:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789129023.616209:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789129023.616210:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789129023.616212:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789129023.616213:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789129023.616214:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789129023.616216:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789129023.616218:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789129023.616219:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789129023.616221:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789129023.616227:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789129023.616231:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789129023.616234:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789129023.616235:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789129023.616235:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789129023.616236:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789129023.616237:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789129023.616238:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789129023.616239:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789129023.616239:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789129023.616240:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789129023.616241:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789129023.616242:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789129023.616269:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789129023.616287:0:7619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626513664:0@lo:253: 00000100:00100000:2.0:1789129023.616383:0:7619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.616429:0:7619:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0a78840 going to sleep for 11 seconds 00000100:00100000:1.0:1789129023.616542:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626513664 00000100:00100000:1.0:1789129023.616551:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626513664 00000100:00100000:1.0:1789129023.616784:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789129023.616796:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:7619:x1876037626513664:12345-0@lo:253: 20000000:01000000:1.0:1789129023.616827:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789129023.616842:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789129023.619130:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3821021c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7634:1876037626513792:0@lo:901: 00000100:00100000:0.0:1789129023.619197:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129023.619228:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015480 going to sleep for 11 seconds 00000100:00100000:1.0:1789129023.622872:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626513792 00000100:00100000:1.0:1789129023.622889:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626513792 00000100:00100000:1.0:1789129023.622991:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789129023.623002:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382102580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7634:x1876037626513792:12345-0@lo:901: 00000100:00100000:1.0:1789129023.623443:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382102580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7634:x1876037626513792:12345-0@lo:901: Request processed in 442us (4245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129023.623451:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789129023.626093:0:7634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b3821021c0 x1876037626513792/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789129039 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129023.626117:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3821021c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7634:1876037626513792:0@lo:901: 00000100:00080000:3.0:1789129023.629907:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1789129023.684166:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789129023.684184:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789129023.684892:0:5856:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789129023.684898:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789129023.684921:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.684940:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b480031c00/0x5c74554e47ce4117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4110 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.684962:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.685004:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b480031c00/0x5c74554e47ce4117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4110 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129023.685018:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b480031c00/0x5c74554e47ce4117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4110 expref: 14 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129023.685034:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b530c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876037626513920:0@lo:104: 00000100:00100000:1.0:1789129023.685104:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129023.685456:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48607dc00 going to sleep for 11 seconds 00010000:00010000:1.0:1789129023.686093:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129023.687786:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626513920 00000100:00100000:3.0:1789129023.687800:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626513920 00000100:00100000:3.0:1789129023.687906:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789129023.687917:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b50b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:5856:x1876037626513920:12345-0@lo:104: 00010000:00010000:3.0:1789129023.687939:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129023.688054:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789129023.688061:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b50b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:5856:x1876037626513920:12345-0@lo:104: Request processed in 146us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129023.688068:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789129023.688152:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b530c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5856:1876037626513920:0@lo:104: 00010000:00010000:2.0:1789129023.688184:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.692323:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129023.692340:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.692360:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129023.692365:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.692376:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129023.692384:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129023.692407:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129023.692472:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.692479:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129023.692507:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.692515:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151b400/0x5c74554e47ce4110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4117 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.692535:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129023.692537:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129023.692539:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129023.692638:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626514048:0@lo:103: 00000100:00100000:1.0:1789129023.692726:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129023.692971:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626514048 00000100:00100000:2.0:1789129023.692981:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626514048 00010000:00010000:2.0:1789129023.693014:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b480031c00/0x5c74554e47ce4117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4110 expref: 15 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129023.693050:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789129023.693059:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:3307:x1876037626514048:12345-0@lo:103: 00010000:00010000:2.0:1789129023.693071:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129023.693076:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b480031c00/0x5c74554e47ce4117 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4110 expref: 15 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693087:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b480031c00/0x5c74554e47ce4117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4110 expref: 15 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693101:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480031c00/0x5c74554e47ce4117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4110 expref: 15 pid: 5834 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693122:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693130:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789129023.693144:0:5825:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008246034s 00010000:00010000:2.0:1789129023.693149:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693155:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693161:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693167:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693172:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481657600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129023.693176:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693183:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693197:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693207:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129023.693247:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:3307:x1876037626514048:12345-0@lo:103: Request processed in 190us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129023.693255:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789129023.693450:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626514048:0@lo:103: 00010000:00010000:2.0:1789129023.693478:0:5856:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693487:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129023.693493:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481657600/0x5c74554e47ce41c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129023.693720:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:7619:x1876037626513664:12345-0@lo:253: Request processed in 76926us (77336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129023.693729:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789129023.694037:0:7619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4a927c41-01d5-424a-b17c-4bdb2d4e760d:7619:1876037626513664:0@lo:253: 10000000:01000000:2.0:1789129023.694049:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789129023.694052:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789129023.694054:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789129023.694056:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789129023.694057:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789129023.694058:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789129023.694060:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789129023.694061:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789129023.694063:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789129023.694065:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789129023.694066:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789129023.694068:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789129023.694081:0:7619:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789129023.698946:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789129023.699135:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789129023.699347:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789129023.699526:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789129023.699791:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:2.0:1789129023.700024:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789129023.702277:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789129024.087008:0:7619:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789129024.087017:0:7619:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789129024.087060:0:7619:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789129024.087134:0:7619:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789129024.087148:0:7619:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789129024.087174:0:7619:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789129024.709968:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129025.734752:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129026.759534:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129026.835769:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789129026.835811:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626514176:0@lo:13: 00000100:00100000:3.0:1789129026.835930:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129026.843800:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626514176 00000100:00100000:2.0:1789129026.843823:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626514176 00000100:00100000:2.0:1789129026.843931:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789129026.843948:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626514176:12345-0@lo:13: 00002000:00000024:2.0:1789129026.844001:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129026.844133:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626514176:12345-0@lo:13: Request processed in 192us (8202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129026.844141:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789129026.844201:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae6d00 x1876037626514176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129026.844240:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626514176:0@lo:13: 00000100:00080000:1.0:1789129026.846744:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789129027.782396:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129028.822284:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129028.877010:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626514304:0@lo:400: 00000100:00100000:0.0:1789129028.877094:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129028.877150:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626514816:0@lo:400: 00000100:00100000:0.0:1789129028.877172:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129028.877196:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129028.877201:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626514688:0@lo:400: 00000100:00100000:0.0:1789129028.877231:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129028.877270:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626514432:0@lo:400: 00000100:00100000:0.0:1789129028.877296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129028.877313:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129028.877318:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626514560:0@lo:400: 00000100:00100000:0.0:1789129028.877348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129028.877373:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626514816 00000100:00100000:0.0:1789129028.877380:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626514816 00000100:00100000:0.0:1789129028.877433:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626514432 00000100:00100000:0.0:1789129028.877435:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626514432 00000100:00100000:0.0:1789129028.877444:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626514560 00000100:00100000:0.0:1789129028.877446:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626514560 00000100:00100000:0.0:1789129028.877459:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789129028.877465:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382102940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626514816:12345-0@lo:400: 00000100:00100000:0.0:1789129028.877511:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382102940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626514816:12345-0@lo:400: Request processed in 46us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129028.877517:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789129028.877530:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789129028.877535:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382101a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626514432:12345-0@lo:400: 00000100:00100000:0.0:1789129028.877556:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382101a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626514432:12345-0@lo:400: Request processed in 21us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129028.877561:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789129028.877569:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789129028.877573:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382101e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626514560:12345-0@lo:400: 00000100:00100000:0.0:1789129028.877593:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382101e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626514560:12345-0@lo:400: Request processed in 20us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129028.877598:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789129028.877643:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789129028.877779:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae6d00 x1876037626514560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129028.877794:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626514560:0@lo:400: 00010000:00080000:0.0:1789129028.877803:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae4780 x1876037626514432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129028.877816:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626514432:0@lo:400: 00010000:00080000:0.0:1789129028.877847:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae4f00 x1876037626514816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129028.877854:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626514816:0@lo:400: 00000100:00100000:3.0:1789129028.878203:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626514304 00000100:00100000:3.0:1789129028.878217:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626514304 00000100:00100000:3.0:1789129028.878246:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789129028.878252:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:3309:x1876037626514304:12345-0@lo:400: 00000100:00100000:3.0:1789129028.878303:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:3309:x1876037626514304:12345-0@lo:400: Request processed in 51us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129028.878309:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789129028.878712:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626514688 00000100:00100000:2.0:1789129028.878717:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626514688 00000100:00100000:2.0:1789129028.878861:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789129028.878868:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626514688:12345-0@lo:400: 00000100:00100000:2.0:1789129028.878916:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626514688:12345-0@lo:400: Request processed in 49us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129028.878921:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789129028.879001:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789129028.879933:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae7840 x1876037626514688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129028.879948:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626514688:0@lo:400: 00000100:00100000:0.0:1789129028.879958:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626514304:0@lo:400: 00010000:00010000:2.0:1789129029.829852:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129030.854641:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789129031.529458:0:7976:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789129031.878217:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129031.955362:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626514944:0@lo:13: 00000100:00100000:2.0:1789129031.955457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129031.955589:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626514944 00000100:00100000:1.0:1789129031.955598:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626514944 00000100:00100000:1.0:1789129031.955680:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789129031.955688:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626514944:12345-0@lo:13: 00002000:00000024:1.0:1789129031.955723:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129031.955764:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626514944:12345-0@lo:13: Request processed in 76us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129031.955783:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789129031.955983:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4c0b512c0 x1876037626514944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129031.956014:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626514944:0@lo:13: 00000100:00080000:3.0:1789129031.956114:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789129032.901970:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789129032.966828:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789129032.966836:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b492084000 from 30 10000000:01000000:3.0:1789129032.966843:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789129032.966909:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129032.966921:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129032.966933:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129032.966959:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515072:0@lo:101: 00000100:00100000:3.0:1789129032.967046:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129032.967118:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789129032.968534:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626515072 00000100:00100000:0.0:1789129032.968548:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626515072 00000100:00100000:0.0:1789129032.968633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789129032.968644:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626515072:12345-0@lo:101: 00010000:00010000:0.0:1789129032.968660:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129032.968679:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce41d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce41cd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129032.968706:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce41d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce41cd expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129032.974418:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce41d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce41cd expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129032.974459:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4200, rc 0) 00000100:00100000:0.0:1789129032.990633:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626515072:12345-0@lo:101: Request processed in 21977us (23573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129032.990650:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789129032.990863:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515072:0@lo:101: 00010000:00010000:3.0:1789129032.990893:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129032.990908:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129032.991002:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515200:0@lo:501: 00000100:00100000:3.0:1789129032.991056:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129032.991099:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789129032.991212:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626515200 00000100:00100000:0.0:1789129032.991219:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626515200 00000100:00100000:0.0:1789129032.991265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789129032.991274:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626515200:12345-0@lo:501: 00000100:00100000:0.0:1789129032.992373:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626515200:12345-0@lo:501: Request processed in 1097us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129032.992383:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789129032.999386:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515200:0@lo:501: 00000100:00100000:3.0:1789129032.999461:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515328:0@lo:503: 00000100:00100000:3.0:1789129032.999537:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129032.999586:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789129032.999593:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626515328 00000100:00100000:1.0:1789129032.999614:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626515328 00000100:00100000:1.0:1789129032.999706:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789129032.999718:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626515328:12345-0@lo:503: 00000100:00100000:1.0:1789129033.000157:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626515328:12345-0@lo:503: Request processed in 441us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129033.000167:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789129033.003795:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515328:0@lo:503: 00000100:00100000:3.0:1789129033.005712:0:8061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8061:1876037626515456:0@lo:502: 00000100:00100000:3.0:1789129033.005802:0:8061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.005849:0:8061:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789129033.005860:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626515456 00000100:00100000:0.0:1789129033.005870:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626515456 00000100:00100000:0.0:1789129033.005924:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789129033.005934:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:8061:x1876037626515456:12345-0@lo:502: 00000100:00100000:0.0:1789129033.006876:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:8061:x1876037626515456:12345-0@lo:502: Request processed in 941us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129033.006886:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789129033.007003:0:8061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8061:1876037626515456:0@lo:502: 00000100:00100000:3.0:1789129033.007055:0:8061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8061:1876037626515584:0@lo:502: 00000100:00100000:3.0:1789129033.007102:0:8061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.007143:0:8061:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789129033.008261:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626515584 00000100:00100000:0.0:1789129033.008274:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626515584 00000100:00100000:0.0:1789129033.008326:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789129033.008335:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:8061:x1876037626515584:12345-0@lo:502: 00000100:00100000:0.0:1789129033.008594:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:8061:x1876037626515584:12345-0@lo:502: Request processed in 259us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129033.008617:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789129033.011338:0:8061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8061:1876037626515584:0@lo:502: 00000040:00080000:1.0:1789129033.011404:0:8061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789129033.011747:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789129033.011768:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789129033.011779:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129033.011790:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129033.011801:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789129033.011803:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789129033.011806:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789129033.011848:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129033.011858:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129033.011867:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129033.011885:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382100f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515712:0@lo:101: 00000100:00100000:0.0:1789129033.011951:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129033.011997:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5ab1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129033.012334:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626515712 00000100:00100000:1.0:1789129033.012341:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626515712 00000100:00100000:1.0:1789129033.012388:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789129033.012397:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626515712:12345-0@lo:101: 00010000:00010000:1.0:1789129033.012410:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129033.012423:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b481656a00/0x5c74554e47ce41e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce41db expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129033.012447:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656a00/0x5c74554e47ce41e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce41db expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129033.012457:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b481656a00/0x5c74554e47ce41e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce41db expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129033.012466:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656a00, rc 0) 00000100:00100000:1.0:1789129033.012505:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626515712:12345-0@lo:101: Request processed in 109us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129033.012520:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789129033.012868:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382100f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515712:0@lo:101: 00010000:00010000:0.0:1789129033.012883:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129033.012892:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129033.012954:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382100f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515840:0@lo:501: 00000100:00100000:0.0:1789129033.012984:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129033.013011:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5ab1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129033.013057:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626515840 00000100:00100000:1.0:1789129033.013062:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626515840 00000100:00100000:1.0:1789129033.013092:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789129033.013099:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626515840:12345-0@lo:501: 00000100:00100000:1.0:1789129033.013499:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626515840:12345-0@lo:501: Request processed in 400us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129033.013506:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789129033.013778:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382100f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515840:0@lo:501: 00000100:00100000:0.0:1789129033.013813:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382100f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515968:0@lo:503: 00000100:00100000:0.0:1789129033.013850:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129033.013905:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5ab1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129033.024900:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626515968 00000100:00100000:1.0:1789129033.024916:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626515968 00000100:00100000:1.0:1789129033.024975:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789129033.024987:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626515968:12345-0@lo:503: 00000100:00100000:1.0:1789129033.025397:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626515968:12345-0@lo:503: Request processed in 411us (11545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129033.025405:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789129033.025567:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382100f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626515968:0@lo:503: 00000100:00100000:0.0:1789129033.035991:0:8064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382100780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8064:1876037626516096:0@lo:502: 00000100:00100000:0.0:1789129033.036085:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129033.036253:0:8064:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5ab16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129033.041843:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626516096 00000100:00100000:2.0:1789129033.041858:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626516096 00000100:00100000:3.0:1789129033.042704:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789129033.042717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8064:x1876037626516096:12345-0@lo:502: 00000100:00100000:3.0:1789129033.044282:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8064:x1876037626516096:12345-0@lo:502: Request processed in 1559us (8189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.044305:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789129033.044402:0:8064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382100780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8064:1876037626516096:0@lo:502: 00000020:01000000:1.0:1789129033.044443:0:8064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789129033.044453:0:8064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129033.044455:0:8064:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789129033.044462:0:8064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789129033.044464:0:8064:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789129033.044497:0:8064:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b52580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8064:1876037626516224:0@lo:502: 00000100:00100000:1.0:1789129033.044546:0:8064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129033.044587:0:8064:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4856e6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789129033.044674:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626516224 00000100:00100000:2.0:1789129033.044681:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626516224 00000100:00100000:2.0:1789129033.044797:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789129033.044808:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8064:x1876037626516224:12345-0@lo:502: 00000100:00100000:2.0:1789129033.045017:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8064:x1876037626516224:12345-0@lo:502: Request processed in 210us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129033.045024:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789129033.045230:0:8064:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b52580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8064:1876037626516224:0@lo:502: 00000020:01000000:3.0:1789129033.045251:0:8064:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129033.045257:0:8064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129033.045259:0:8064:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789129033.045273:0:8064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1789129033.045635:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789129033.045652:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789129033.045662:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.045672:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129033.045683:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789129033.045686:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b4921dd800 from 30 10000000:01000000:2.0:1789129033.045689:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789129033.045995:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.046005:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.046016:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129033.046044:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626516352:0@lo:101: 00000100:00100000:2.0:1789129033.046086:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129033.046121:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789129033.046156:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626516352 00000100:00100000:3.0:1789129033.046162:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626516352 00000100:00100000:3.0:1789129033.046207:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789129033.046215:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626516352:12345-0@lo:101: 00010000:00010000:3.0:1789129033.046226:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129033.046239:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151b400/0x5c74554e47ce41f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce41e9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.046264:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151b400/0x5c74554e47ce41f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce41e9 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.046277:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151b400/0x5c74554e47ce41f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce41e9 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.046286:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b400, rc 0) 00000100:00100000:3.0:1789129033.046323:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626516352:12345-0@lo:101: Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.046329:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789129033.046547:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626516352:0@lo:101: 00010000:00010000:3.0:1789129033.046663:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.046684:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129033.046756:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626516480:0@lo:501: 00000100:00100000:3.0:1789129033.046788:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.046800:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789129033.046817:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626516480 00000100:00100000:3.0:1789129033.046820:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626516480 00000100:00100000:3.0:1789129033.046849:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789129033.046856:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626516480:12345-0@lo:501: 00000100:00100000:3.0:1789129033.047851:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626516480:12345-0@lo:501: Request processed in 992us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.047861:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789129033.047873:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626516480:0@lo:501: 00000100:00100000:2.0:1789129033.047921:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626516608:0@lo:503: 00000100:00100000:2.0:1789129033.047963:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129033.047997:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129033.048041:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626516608 00000100:00100000:1.0:1789129033.048052:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626516608 00000100:00100000:1.0:1789129033.048091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789129033.048099:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626516608:12345-0@lo:503: 00000100:00100000:1.0:1789129033.048271:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626516608:12345-0@lo:503: Request processed in 172us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129033.048278:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789129033.048507:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626516608:0@lo:503: 00000100:00100000:2.0:1789129033.049708:0:8066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8066:1876037626516736:0@lo:502: 00000100:00100000:2.0:1789129033.049838:0:8066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129033.049878:0:8066:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129033.049925:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626516736 00000100:00100000:3.0:1789129033.049932:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626516736 00000100:00100000:3.0:1789129033.049967:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789129033.049974:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:8066:x1876037626516736:12345-0@lo:502: 00000100:00100000:3.0:1789129033.050385:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:8066:x1876037626516736:12345-0@lo:502: Request processed in 410us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.050392:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789129033.050882:0:8066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8066:1876037626516736:0@lo:502: 00000100:00100000:2.0:1789129033.050946:0:8066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8066:1876037626516864:0@lo:502: 00000100:00100000:2.0:1789129033.050989:0:8066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129033.051023:0:8066:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129033.051130:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626516864 00000100:00100000:3.0:1789129033.051135:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626516864 00000100:00100000:3.0:1789129033.051264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789129033.051271:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:8066:x1876037626516864:12345-0@lo:502: 00000100:00100000:3.0:1789129033.051533:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:8066:x1876037626516864:12345-0@lo:502: Request processed in 261us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.051540:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789129033.051725:0:8066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8066:1876037626516864:0@lo:502: 00000040:00080000:3.0:1789129033.051750:0:8066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789129033.051816:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789129033.051835:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789129033.051844:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.051855:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129033.051866:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789129033.051869:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b4921dd800 from 5 10000000:01000000:3.0:1789129033.051872:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789129033.051914:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.051923:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.051931:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129033.051944:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626516992:0@lo:101: 00000100:00100000:3.0:1789129033.051973:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.051989:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789129033.052001:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626516992 00000100:00100000:3.0:1789129033.052010:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626516992 00000100:00100000:3.0:1789129033.052032:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789129033.052039:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626516992:12345-0@lo:101: 00010000:00010000:3.0:1789129033.052048:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129033.052061:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151bc00/0x5c74554e47ce41fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce41f7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.052084:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151bc00/0x5c74554e47ce41fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce41f7 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.052094:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151bc00/0x5c74554e47ce41fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce41f7 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.052103:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151bc00, rc 0) 00000100:00100000:3.0:1789129033.052130:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626516992:12345-0@lo:101: Request processed in 91us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.052149:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789129033.053247:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626516992:0@lo:101: 00010000:00010000:3.0:1789129033.053269:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.053280:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129033.053336:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626517120:0@lo:256: 00000100:00100000:3.0:1789129033.053682:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.053706:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789129033.053722:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626517120 00000100:00100000:3.0:1789129033.053727:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626517120 00000100:00100000:3.0:1789129033.053763:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789129033.053770:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626517120:12345-0@lo:256: 20000000:01000000:3.0:1789129033.053788:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789129033.053804:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789129033.053807:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789129033.053880:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626517120:12345-0@lo:256: Request processed in 110us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.053887:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789129033.053932:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626517120:0@lo:256: 10000000:01000000:3.0:1789129033.053968:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789129033.053974:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.053983:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129033.053991:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789129033.053994:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789129033.053996:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789129033.054014:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.054021:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.054029:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129033.054041:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626517248:0@lo:101: 00000100:00100000:3.0:1789129033.054083:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.054097:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789129033.054107:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626517248 00000100:00100000:3.0:1789129033.054110:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626517248 00000100:00100000:3.0:1789129033.054129:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789129033.054146:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626517248:12345-0@lo:101: 00010000:00010000:3.0:1789129033.054155:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129033.054168:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b480031c00/0x5c74554e47ce420c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4205 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.054194:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b480031c00/0x5c74554e47ce420c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4205 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.054203:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b480031c00/0x5c74554e47ce420c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4205 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.054211:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031c00, rc 0) 00000100:00100000:3.0:1789129033.054237:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626517248:12345-0@lo:101: Request processed in 103us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.054243:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789129033.054269:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626517248:0@lo:101: 00010000:00010000:3.0:1789129033.054279:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129033.055951:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129033.056207:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626517376:0@lo:501: 00000100:00100000:3.0:1789129033.056299:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.056409:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789129033.056683:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626517376 00000100:00100000:2.0:1789129033.056693:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626517376 00000100:00100000:3.0:1789129033.056811:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789129033.056822:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626517376:12345-0@lo:501: 00000100:00100000:3.0:1789129033.057852:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626517376:12345-0@lo:501: Request processed in 1026us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.057863:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789129033.057895:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626517376:0@lo:501: 00000100:00100000:2.0:1789129033.057947:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626517504:0@lo:503: 00000100:00100000:2.0:1789129033.057994:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129033.058031:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129033.058080:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626517504 00000100:00100000:1.0:1789129033.058085:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626517504 00000100:00100000:1.0:1789129033.058681:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789129033.058694:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626517504:12345-0@lo:503: 00000100:00100000:1.0:1789129033.059076:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626517504:12345-0@lo:503: Request processed in 385us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129033.059084:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789129033.068812:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626517504:0@lo:503: 00000100:00100000:1.0:1789129033.069437:0:8068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b52940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8068:1876037626517632:0@lo:502: 00000100:00100000:1.0:1789129033.069516:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129033.069634:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483013780 going to sleep for 11 seconds 00000100:00100000:2.0:1789129033.087551:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626517632 00000100:00100000:2.0:1789129033.087581:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626517632 00000100:00100000:3.0:1789129033.087792:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789129033.087804:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8068:x1876037626517632:12345-0@lo:502: 00000100:00100000:3.0:1789129033.088258:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8068:x1876037626517632:12345-0@lo:502: Request processed in 455us (18741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.088266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789129033.088406:0:8068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b52940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8068:1876037626517632:0@lo:502: 00000020:01000000:2.0:1789129033.088448:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789129033.088464:0:8068:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789129033.088473:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129033.088476:0:8068:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789129033.088481:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789129033.088485:0:8068:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:2.0:1789129033.088513:0:8068:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789129033.088516:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789129033.088533:0:8068:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90b4b5761a48) 00000020:00000080:2.0:1789129033.088563:0:8068:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789129033.088569:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789129033.088744:0:8068:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789129033.088750:0:8068:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789129033.088757:0:8068:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce421a 00010000:00080000:2.0:1789129033.088787:0:8068:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b489cb7000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:2.0:1789129033.089026:0:8068:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1789129033.106526:0:8068:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789129033.106562:0:8068:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789129033.119069:0:8068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789129033.119384:0:8068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789129033.119590:0:8068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789129033.119756:0:8068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789129033.127861:0:8071:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789129033.127871:0:8071:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789129033.134298:0:8068:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789129033.134564:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789129033.134676:0:8068:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789129033.134763:0:8068:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce4221 00000100:00080000:1.0:1789129033.134777:0:8068:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789129033.134783:0:8068:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b489cb7000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789129033.134826:0:8068:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4c0b53480 x1876037626517760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789129033.134870:0:8068:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789129033.134896:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626517760:0@lo:8: 00000100:00100000:0.0:1789129033.134976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789129033.135031:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789129033.135035:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129033.135037:0:8068:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789129033.135040:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789129033.135044:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129033.135046:0:8068:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789129033.135048:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789129033.135050:0:8068:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789129033.135059:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626517760 00000100:00100000:0.0:1789129033.135066:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626517760 00000100:00100000:1.0:1789129033.135089:0:8068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b51a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8068:1876037626517888:0@lo:502: 00000100:00100000:0.0:1789129033.135104:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789129033.135113:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382101680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876037626517760:12345-0@lo:8: 00000100:00100000:1.0:1789129033.135134:0:8068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789129033.135140:0:6688:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000100:00100000:1.0:1789129033.135160:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626517888 00000100:00100000:1.0:1789129033.135163:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626517888 00000020:00000080:0.0:1789129033.135166:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce4228 00002000:00100000:0.0:1789129033.135180:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90b4c0948800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789129033.135197:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1789129033.135201:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789129033.135205:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789129033.135212:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8068:x1876037626517888:12345-0@lo:502: 00002000:00100000:0.0:1789129033.135369:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789129033.135534:0:6688:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789129033.135561:0:6688:0:(import.c:65:import_set_state_nolock()) ffff90b4c094c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789129033.135564:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8068:x1876037626517888:12345-0@lo:502: Request processed in 351us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129033.135572:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789129033.135632:0:8068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0cb5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789129033.135636:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382101680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876037626517760:12345-0@lo:8: Request processed in 525us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129033.135643:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789129033.135651:0:8068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b51a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8068:1876037626517888:0@lo:502: 00000020:01000000:1.0:1789129033.135673:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00080000:0.0:1789129033.135673:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4c0b53480 x1876037626517760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789129043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1789129033.135677:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129033.135679:0:8068:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789129033.135682:0:8068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1789129033.135683:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789129033.135690:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789129033.135698:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789129033.135702:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789129033.135705:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b489cb7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789129033.135727:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789129033.135732:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626517760:0@lo:8: 00000004:00080000:0.0:1789129033.135754:0:8071:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789129033.135856:0:8071:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 196233253244ns, next at 0ns, rc = 0 00000020:01000000:2.0:1789129033.136292:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 00000100:00100000:1.0:1789129033.136506:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626518144:0@lo:400: 00000100:00100000:0.0:1789129033.136550:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626518272:0@lo:400: 00000100:00100000:0.0:1789129033.136584:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129033.136592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129033.136645:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626518144 00000100:00100000:0.0:1789129033.136645:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626518272 00000100:00100000:1.0:1789129033.136651:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626518144 00000100:00100000:0.0:1789129033.136651:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626518272 00000100:00100000:0.0:1789129033.136692:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789129033.136700:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3821003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626518272:12345-0@lo:400: 10000000:01000000:2.0:1789129033.136708:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789129033.136721:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.136735:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129033.136747:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789129033.136750:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90b487c73490 from 1 10000000:01000000:2.0:1789129033.136754:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789129033.136789:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.136798:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.136819:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129033.136834:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626518528:0@lo:101: 00000100:00100000:2.0:1789129033.136871:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129033.136895:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789129033.136899:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3821003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626518272:12345-0@lo:400: Request processed in 200us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129033.136907:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789129033.136920:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626518016:0@lo:400: 00000100:00100000:2.0:1789129033.136947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129033.136968:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789129033.136973:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626518400:0@lo:400: 00000100:00100000:2.0:1789129033.136994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129033.137022:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626518528 00000100:00100000:2.0:1789129033.137026:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626518528 00000100:00100000:2.0:1789129033.137052:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789129033.137058:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626518528:12345-0@lo:101: 00010000:00010000:2.0:1789129033.137080:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129033.137094:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b86800/0x5c74554e47ce4236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce422f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.137118:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b86800/0x5c74554e47ce4236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce422f expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.137129:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b86800/0x5c74554e47ce4236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce422f expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.137139:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86800, rc 0) 00000100:00100000:2.0:1789129033.137166:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626518528:12345-0@lo:101: Request processed in 108us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129033.137179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789129033.137231:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626518528:0@lo:101: 00010000:00010000:2.0:1789129033.137246:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.137256:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129033.137325:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626518656:0@lo:501: 00000100:00100000:2.0:1789129033.137567:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129033.137585:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789129033.137599:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626518656 00000100:00100000:2.0:1789129033.137622:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626518656 00000100:00100000:2.0:1789129033.137649:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789129033.137662:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626518656:12345-0@lo:501: 00000100:00100000:2.0:1789129033.137930:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626518656:12345-0@lo:501: Request processed in 269us (579us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789129033.137938:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789129033.137971:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626518656:0@lo:501: 10000000:01000000:2.0:1789129033.137998:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789129033.138005:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129033.138014:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129033.138634:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626518016 00000100:00100000:1.0:1789129033.138641:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626518016 00000100:00100000:1.0:1789129033.138657:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626518400 00000100:00100000:1.0:1789129033.138660:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626518400 00000100:00100000:1.0:1789129033.138678:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789129033.138686:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626518144:12345-0@lo:400: 00000100:00100000:1.0:1789129033.138737:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626518144:12345-0@lo:400: Request processed in 52us (2144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129033.138744:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789129033.138758:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789129033.138764:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626518016:12345-0@lo:400: 00000100:00100000:1.0:1789129033.138802:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626518016:12345-0@lo:400: Request processed in 38us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129033.138807:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789129033.138819:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789129033.138825:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626518400:12345-0@lo:400: 00000100:00100000:1.0:1789129033.138857:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626518400:12345-0@lo:400: Request processed in 32us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129033.138861:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789129033.139039:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780cb40 x1876037626518400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129033.139126:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626518400:0@lo:400: 00010000:00080000:1.0:1789129033.139146:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780d680 x1876037626518016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129033.139156:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626518016:0@lo:400: 00010000:00080000:1.0:1789129033.139239:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780c3c0 x1876037626518144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129033.139258:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626518144:0@lo:400: 00010000:00080000:1.0:1789129033.140482:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780fc00 x1876037626518272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129033.140503:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626518272:0@lo:400: 00000100:00080000:0.0:1789129033.141831:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789129033.141842:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789129033.240683:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789129033.261191:0:8073:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789129033.261235:0:8073:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1876037626518912:0@lo:7: 00000100:00100000:3.0:1789129033.261339:0:8073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.261406:0:8073:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789129033.261411:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626518912 00000100:00100000:0.0:1789129033.261421:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626518912 00000100:00100000:3.0:1789129033.261423:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129033.261437:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626518784:0@lo:13: 00000100:00100000:3.0:1789129033.261465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129033.261489:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789129033.261500:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8073:x1876037626518912:12345-0@lo:7: 00000100:00100000:3.0:1789129033.261751:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626518784 00000100:00100000:3.0:1789129033.261755:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626518784 00000100:00100000:3.0:1789129033.261790:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789129033.261796:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626518784:12345-0@lo:13: 00002000:00000024:3.0:1789129033.261825:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789129033.261877:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626518784:12345-0@lo:13: Request processed in 80us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.261884:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789129033.261931:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae61c0 x1876037626518784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129033.261954:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626518784:0@lo:13: 00000100:00080000:2.0:1789129033.262699:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1789129033.268023:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789129033.268030:0:6686:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789129033.268130:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8073:x1876037626518912:12345-0@lo:7: Request processed in 6629us (6789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129033.268139:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789129033.268375:0:8073:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae7840 x1876037626518912/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789129049 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129033.268393:0:8073:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1876037626518912:0@lo:7: 00000004:00080000:3.0:1789129033.268410:0:8073:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789129033.268453:0:8073:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1876037626519040:0@lo:5: 00000100:00100000:3.0:1789129033.268489:0:8073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.268775:0:8073:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129033.268839:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626519040 00000100:00100000:1.0:1789129033.268844:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626519040 00000100:00100000:1.0:1789129033.268881:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789129033.268890:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8073:x1876037626519040:12345-0@lo:5: 00002000:00080000:1.0:1789129033.268916:0:6688:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789129033.268920:0:6688:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789129033.269139:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8073:x1876037626519040:12345-0@lo:5: Request processed in 250us (650us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789129033.269147:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789129033.269225:0:8073:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae7840 x1876037626519040/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789129049 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129033.269235:0:8073:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1876037626519040:0@lo:5: 00000004:00080000:3.0:1789129033.269242:0:8073:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789129033.269264:0:8073:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1876037626519168:0@lo:700: 00000100:00100000:3.0:1789129033.269283:0:8073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.269301:0:8073:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129033.269324:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626519168 00000100:00100000:1.0:1789129033.269329:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626519168 00000100:00100000:2.0:1789129033.270642:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789129033.270661:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8073:x1876037626519168:12345-0@lo:700: 00000100:00100000:2.0:1789129033.270719:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1876037626519296:0@lo:700: 00000100:00100000:2.0:1789129033.270763:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129033.270803:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0a78180 going to sleep for 11 seconds 00000100:00100000:0.0:1789129033.270810:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626519296 00000100:00100000:0.0:1789129033.270817:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626519296 00000100:00100000:0.0:1789129033.270846:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789129033.270854:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1876037626519296:12345-0@lo:700: 40000000:02000000:3.0:1789129033.284883:0:5847:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789129033.288221:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1876037626519296:12345-0@lo:700: Request processed in 17352us (17440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129033.288266:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789129033.288363:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780c780 x1876037626519296/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789129049 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129033.288378:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1876037626519296:0@lo:700: 40000000:02000000:2.0:1789129033.288394:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1789129033.325114:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789129033.325145:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1789129033.325177:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8073:x1876037626519168:12345-0@lo:700: Request processed in 54521us (55887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129033.325202:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789129033.325240:0:8073:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae6d00 x1876037626519168/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789129049 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129033.325260:0:8073:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1876037626519168:0@lo:700: 00000004:02000040:3.0:1789129033.341089:0:8073:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789129033.344503:0:8073:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1876037626519424:0@lo:5: 00000100:00100000:3.0:1789129033.344658:0:8073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129033.344860:0:8073:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0b43480 going to sleep for 11 seconds 00000100:00100000:0.0:1789129033.344956:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626519424 00000100:00100000:0.0:1789129033.344964:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626519424 00000100:00100000:0.0:1789129033.345016:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789129033.345027:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8073:x1876037626519424:12345-0@lo:5: 00002000:00080000:2.0:1789129033.349556:0:6686:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789129033.349581:0:6686:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789129033.353593:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8073:x1876037626519424:12345-0@lo:5: Request processed in 8556us (8923us total) trans 4294967298 rc 0/0 00010000:00080000:3.0:1789129033.353672:0:8073:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae6d00 x1876037626519424/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789129049 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129033.353690:0:8073:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789129033.353699:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789129033.353713:0:8073:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b498ae6d00 x1876037626519424/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789129049 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129033.353726:0:8073:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8073:1876037626519424:0@lo:5: 00000004:00080000:3.0:1789129033.353748:0:8073:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1789129033.926115:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129034.960887:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129035.976443:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129036.998126:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129037.068941:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626519552:0@lo:13: 00000100:00100000:0.0:1789129037.069065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129037.070859:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626519552 00000100:00100000:1.0:1789129037.070881:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626519552 00000100:00100000:1.0:1789129037.070957:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789129037.070968:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382100b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626519552:12345-0@lo:13: 00002000:00000024:1.0:1789129037.071015:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129037.071570:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382100b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626519552:12345-0@lo:13: Request processed in 601us (2502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129037.071580:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789129037.071654:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129037.071701:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4c0b51e00 x1876037626519552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129037.071726:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b51e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626519552:0@lo:13: 00000001:00080000:1.0:1789129037.131423:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1789129037.653879:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129037.655403:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604475008 00000100:00100000:2.0:1789129037.655421:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604475008 00000100:00100000:2.0:1789129037.655486:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:2.0:1789129037.655496:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2366:x1876037604475008:12345-192.168.201.39@tcp:250: 00010000:00080000:2.0:1789129037.655536:0:5834:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from f39f4e36-8626-43c5-a083-60799197f867@192.168.201.39@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1789129037.655574:0:5834:0:(genops.c:1385:class_connect()) connect: client f39f4e36-8626-43c5-a083-60799197f867, cookie 0x5c74554e47ce423d 00000100:00080000:2.0:1789129037.655798:0:5834:0:(import.c:65:import_set_state_nolock()) ffff90b489cb2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789129037.656070:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+5:2366:x1876037604475008:12345-192.168.201.39@tcp:250: Request processed in 572us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129037.656095:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:1.0:1789129037.685783:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129037.685845:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604475136 00000100:00100000:1.0:1789129037.685857:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604475136 00000100:00100000:1.0:1789129037.685924:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:1.0:1789129037.685934:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+5:5598:x1876037604475136:12345-192.168.201.39@tcp:101: 00010000:00010000:1.0:1789129037.685952:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129037.685972:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b481657600/0x5c74554e47ce4244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa75c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129037.686009:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481657600/0x5c74554e47ce4244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa75c expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129037.686020:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b481657600/0x5c74554e47ce4244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa75c expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129037.686030:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657600, rc 0) 00000100:00100000:1.0:1789129037.686116:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+6:5598:x1876037604475136:12345-192.168.201.39@tcp:101: Request processed in 184us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129037.686124:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:1.0:1789129037.691426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129037.695091:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604475264 00000100:00100000:3.0:1789129037.695118:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604475264 00000100:00100000:3.0:1789129037.695181:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:3.0:1789129037.695192:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+6:5598:x1876037604475264:12345-192.168.201.39@tcp:501: 00000100:00100000:3.0:1789129037.695733:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+6:5598:x1876037604475264:12345-192.168.201.39@tcp:501: Request processed in 540us (4314us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789129037.695751:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:1.0:1789129037.709141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129037.709759:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604475392 00000100:00100000:2.0:1789129037.709770:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604475392 00000100:00100000:2.0:1789129037.709836:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:2.0:1789129037.709846:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+6:5598:x1876037604475392:12345-192.168.201.39@tcp:101: 00010000:00010000:2.0:1789129037.709862:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129037.709880:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b87000/0x5c74554e47ce424b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa763 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129037.709907:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b87000/0x5c74554e47ce424b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa763 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129037.709919:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b87000/0x5c74554e47ce424b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa763 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129037.709928:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87000, rc 0) 00000100:00100000:2.0:1789129037.709996:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+7:5598:x1876037604475392:12345-192.168.201.39@tcp:101: Request processed in 152us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129037.710010:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:1.0:1789129037.713812:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129037.713921:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604475520 00000100:00100000:3.0:1789129037.713931:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604475520 00000100:00100000:3.0:1789129037.713983:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789129037.713993:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+7:5598:x1876037604475520:12345-192.168.201.39@tcp:501: 00000100:00100000:3.0:1789129037.714295:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+8:5598:x1876037604475520:12345-192.168.201.39@tcp:501: Request processed in 301us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129037.714303:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:3.0:1789129037.723667:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129037.723709:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604475648 00000100:00100000:3.0:1789129037.723719:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604475648 00000100:00100000:3.0:1789129037.723771:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:3.0:1789129037.723782:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+8:5598:x1876037604475648:12345-192.168.201.39@tcp:503: 00000100:00100000:3.0:1789129037.724089:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+8:5598:x1876037604475648:12345-192.168.201.39@tcp:503: Request processed in 307us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129037.724098:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:2.0:1789129037.753108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129037.755872:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604475776 00000100:00100000:3.0:1789129037.755888:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604475776 00000100:00100000:3.0:1789129037.755972:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:3.0:1789129037.755983:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+8:5617:x1876037604475776:12345-192.168.201.39@tcp:502: 00000100:00100000:3.0:1789129037.756311:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+8:5617:x1876037604475776:12345-192.168.201.39@tcp:502: Request processed in 329us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129037.756319:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:1.0:1789129037.798261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129037.798383:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604475904 00000100:00100000:3.0:1789129037.798393:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604475904 00000100:00100000:3.0:1789129037.798459:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:3.0:1789129037.798469:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+8:5617:x1876037604475904:12345-192.168.201.39@tcp:502: 00000100:00100000:3.0:1789129037.805163:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+8:5617:x1876037604475904:12345-192.168.201.39@tcp:502: Request processed in 6688us (6904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129037.805173:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:2.0:1789129037.818157:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129037.818229:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604476032 00000100:00100000:3.0:1789129037.818241:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604476032 00000100:00100000:3.0:1789129037.818303:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:3.0:1789129037.818314:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+8:5598:x1876037604476032:12345-192.168.201.39@tcp:101: 00010000:00010000:3.0:1789129037.818333:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129037.818354:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b480031800/0x5c74554e47ce4252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa78d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129037.818386:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b480031800/0x5c74554e47ce4252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa78d expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129037.818398:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b480031800/0x5c74554e47ce4252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa78d expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129037.818408:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031800, rc 0) 00000100:00100000:3.0:1789129037.818466:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+9:5598:x1876037604476032:12345-192.168.201.39@tcp:101: Request processed in 154us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129037.818473:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:1.0:1789129037.836855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129037.845730:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604476160 00000100:00100000:3.0:1789129037.845747:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604476160 00000100:00100000:3.0:1789129037.846633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:3.0:1789129037.846649:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+9:5598:x1876037604476160:12345-192.168.201.39@tcp:256: 20000000:01000000:3.0:1789129037.846675:0:5833:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789129037.846699:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789129037.846708:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789129037.846712:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789129037.846714:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789129037.849149:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+9:5598:x1876037604476160:12345-192.168.201.39@tcp:256: Request processed in 2494us (12299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129037.849215:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:2.0:1789129037.859362:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129037.859488:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604476288 00000100:00100000:0.0:1789129037.859503:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604476288 00000100:00100000:0.0:1789129037.859631:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:0.0:1789129037.859644:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+9:5598:x1876037604476288:12345-192.168.201.39@tcp:101: 00010000:00010000:0.0:1789129037.859667:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129037.859708:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce4259 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa794 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129037.859761:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce4259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa794 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129037.859775:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce4259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa794 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129037.859787:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5800, rc 0) 00000100:00100000:0.0:1789129037.859857:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:5598:x1876037604476288:12345-192.168.201.39@tcp:101: Request processed in 216us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129037.859866:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:1.0:1789129037.869892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129037.869985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604476416 00000100:00100000:0.0:1789129037.869998:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604476416 00000100:00100000:0.0:1789129037.870070:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:0.0:1789129037.870081:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:5598:x1876037604476416:12345-192.168.201.39@tcp:501: 00000100:00100000:0.0:1789129037.870358:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:5598:x1876037604476416:12345-192.168.201.39@tcp:501: Request processed in 278us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129037.870366:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:1.0:1789129037.876076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129037.876362:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604476544 00000100:00100000:2.0:1789129037.876373:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604476544 00000100:00100000:2.0:1789129037.876519:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:2.0:1789129037.876532:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:5598:x1876037604476544:12345-192.168.201.39@tcp:503: 00000100:00100000:2.0:1789129037.877123:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:5598:x1876037604476544:12345-192.168.201.39@tcp:503: Request processed in 590us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129037.877141:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:1.0:1789129037.885171:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129037.885210:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604476672 00000100:00100000:3.0:1789129037.885221:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604476672 00000100:00100000:3.0:1789129037.885296:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:3.0:1789129037.885308:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:5621:x1876037604476672:12345-192.168.201.39@tcp:502: 00000100:00100000:3.0:1789129037.888158:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:5621:x1876037604476672:12345-192.168.201.39@tcp:502: Request processed in 2830us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129037.888177:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:1.0:1789129037.916234:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129037.916448:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604476800 00000100:00100000:3.0:1789129037.916458:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604476800 00000100:00100000:3.0:1789129037.916522:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:3.0:1789129037.916533:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:5621:x1876037604476800:12345-192.168.201.39@tcp:502: 00000100:00100000:3.0:1789129037.916809:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:5621:x1876037604476800:12345-192.168.201.39@tcp:502: Request processed in 277us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129037.916827:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:0.0:1789129037.922551:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129037.922630:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604476928 00000100:00100000:1.0:1789129037.922641:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604476928 00000100:00100000:1.0:1789129037.922696:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:1.0:1789129037.922707:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382103c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2366:x1876037604476928:12345-192.168.201.39@tcp:38: 00010000:00080000:1.0:1789129037.922757:0:6710:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1789129037.923135:0:6710:0:(genops.c:1385:class_connect()) connect: client 9463e625-4f12-4089-85aa-d90aafb8e5a9, cookie 0x5c74554e47ce4260 00000004:00100000:1.0:1789129037.923165:0:6710:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:1.0:1789129037.923171:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789129038.003619:0:6710:0:(import.c:65:import_set_state_nolock()) ffff90b4856bf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789129038.003716:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382103c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2366:x1876037604476928:12345-192.168.201.39@tcp:38: Request processed in 81009us (81173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129038.003728:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00010000:00010000:1.0:1789129038.023709:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129038.600116:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129038.600164:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626519680:0@lo:13: 00000100:00100000:1.0:1789129038.600294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129038.601823:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626519808:0@lo:400: 00000100:00100000:1.0:1789129038.601852:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626520064:0@lo:400: 00000100:00100000:3.0:1789129038.601938:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626519680 00000100:00100000:3.0:1789129038.601947:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626519680 00000100:00100000:3.0:1789129038.602028:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789129038.602051:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b51e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626519680:12345-0@lo:13: 00002000:00000024:3.0:1789129038.602107:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129038.602724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129038.602781:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129038.602788:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626520192:0@lo:400: 00000100:00100000:1.0:1789129038.602823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789129038.602856:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789129038.602964:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626520064 00000100:00100000:1.0:1789129038.602971:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626520064 00000100:00100000:1.0:1789129038.603109:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789129038.603118:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626520064:12345-0@lo:400: 00000100:00100000:1.0:1789129038.603179:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626520064:12345-0@lo:400: Request processed in 62us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129038.603188:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789129038.603219:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626520192 00000100:00100000:1.0:1789129038.603223:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626520192 00000100:00100000:1.0:1789129038.603254:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789129038.603280:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626520192:12345-0@lo:400: 00000100:00100000:1.0:1789129038.603317:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626520192:12345-0@lo:400: Request processed in 37us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129038.603323:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789129038.603371:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780d2c0 x1876037626520192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129038.603387:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626520192:0@lo:400: 00010000:00080000:1.0:1789129038.603400:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780e940 x1876037626520064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129038.603409:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626520064:0@lo:400: 00000100:00080000:0.0:1789129038.607913:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129038.613788:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b51e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626519680:12345-0@lo:13: Request processed in 11736us (13478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129038.613808:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789129038.617034:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626519936:0@lo:400: 00010000:00080000:1.0:1789129038.617103:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498ae7480 x1876037626519680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129038.617119:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789129038.617158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129038.617161:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626519680:0@lo:13: 00000100:00100000:0.0:1789129038.618242:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626519936 00000100:00100000:0.0:1789129038.618259:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626519936 00000100:00100000:0.0:1789129038.618340:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789129038.618355:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626519936:12345-0@lo:400: 00000100:00100000:0.0:1789129038.618497:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626519936:12345-0@lo:400: Request processed in 146us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129038.618529:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789129038.618587:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780f0c0 x1876037626519936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129038.618652:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626519936:0@lo:400: 00000100:00100000:2.0:1789129038.626748:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129038.627388:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626520320:0@lo:400: 00000100:00100000:0.0:1789129038.627730:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626519808 00000100:00100000:0.0:1789129038.627741:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626519808 00000100:00100000:0.0:1789129038.627815:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789129038.627825:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626519808:12345-0@lo:400: 00000100:00100000:0.0:1789129038.627924:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626519808:12345-0@lo:400: Request processed in 101us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129038.627932:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789129038.628189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129038.628249:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626519808:0@lo:400: 00000100:00100000:0.0:1789129038.628427:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626520320 00000100:00100000:0.0:1789129038.628432:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626520320 00000100:00100000:0.0:1789129038.628492:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789129038.628499:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626520320:12345-0@lo:400: 00000100:00100000:0.0:1789129038.628549:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626520320:12345-0@lo:400: Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129038.628555:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789129038.628591:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780e1c0 x1876037626520320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129038.628636:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626520320:0@lo:400: 00000100:00080000:2.0:1789129038.629014:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129038.765850:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129038.765916:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129038.766080:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604477056 00000100:00100000:2.0:1789129038.766105:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604477056 00000100:00100000:2.0:1789129038.766217:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604477184 00000100:00100000:2.0:1789129038.766221:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604477184 00000100:00100000:2.0:1789129038.766256:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1789129038.766267:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:0:x1876037604477056:12345-192.168.201.39@tcp:41: 00000004:00000024:2.0:1789129038.766337:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789129038.766590:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:0:x1876037604477056:12345-192.168.201.39@tcp:41: Request processed in 324us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129038.766730:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1789129038.766767:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789129038.766778:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:5598:x1876037604477184:12345-192.168.201.39@tcp:41: 00000004:00000024:2.0:1789129038.766794:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789129038.766822:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:5598:x1876037604477184:12345-192.168.201.39@tcp:41: Request processed in 48us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129038.766828:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00080000:1.0:1789129038.770534:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129038.776287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129038.776341:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604477312 00000100:00100000:3.0:1789129038.776358:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604477312 00000100:00100000:3.0:1789129038.776437:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789129038.776451:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:5598:x1876037604477312:12345-192.168.201.39@tcp:40: 00000100:00100000:3.0:1789129038.776593:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:5598:x1876037604477312:12345-192.168.201.39@tcp:40: Request processed in 144us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129038.776628:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789129038.781363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129038.781509:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129038.781596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129038.781686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129038.781791:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604477440 00000100:00100000:3.0:1789129038.781807:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604477440 00000100:00100000:3.0:1789129038.781860:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604477568 00000100:00100000:3.0:1789129038.781864:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604477568 00000100:00100000:3.0:1789129038.781881:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1789129038.781892:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037604477440:12345-192.168.201.39@tcp:8: 00010000:00080000:3.0:1789129038.781944:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1789129038.781994:0:6686:0:(genops.c:1385:class_connect()) connect: client 9463e625-4f12-4089-85aa-d90aafb8e5a9, cookie 0x5c74554e47ce4267 00002000:00100000:3.0:1789129038.782011:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9463e625-4f12-4089-85aa-d90aafb8e5a9/ffff90b4a7800000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789129038.782025:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:0.0:1789129038.786149:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604477824 00000100:00100000:0.0:1789129038.786173:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604477824 00000100:00100000:0.0:1789129038.786258:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:0.0:1789129038.786272:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:2370:x1876037604477824:12345-192.168.201.39@tcp:400: 00000100:00100000:0.0:1789129038.786434:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:2370:x1876037604477824:12345-192.168.201.39@tcp:400: Request processed in 163us (4924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129038.786444:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:1.0:1789129038.795711:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604477696 00000100:00100000:1.0:1789129038.795734:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604477696 00000100:00100000:1.0:1789129038.795842:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1789129038.795857:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:5598:x1876037604477696:12345-192.168.201.39@tcp:33: 00002000:00080000:3.0:1789129038.799257:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789129038.800224:0:6686:0:(import.c:65:import_set_state_nolock()) ffff90b4a7805000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789129038.800365:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2366:x1876037604477440:12345-192.168.201.39@tcp:8: Request processed in 18470us (18765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129038.800380:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1789129038.800440:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789129038.800448:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037604477568:12345-192.168.201.39@tcp:8: 00010000:00080000:3.0:1789129038.800476:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1789129038.800519:0:6686:0:(genops.c:1385:class_connect()) connect: client 9463e625-4f12-4089-85aa-d90aafb8e5a9, cookie 0x5c74554e47ce426e 00002000:00100000:3.0:1789129038.800534:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9463e625-4f12-4089-85aa-d90aafb8e5a9/ffff90b4a7800800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789129038.800548:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1789129038.801051:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789129038.801078:0:6686:0:(import.c:65:import_set_state_nolock()) ffff90b4a7803000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789129038.801122:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2366:x1876037604477568:12345-192.168.201.39@tcp:8: Request processed in 673us (19435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129038.801130:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000004:00080000:3.0:1789129038.818845:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 22872us 00000004:00200000:1.0:1789129038.855308:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1789129038.855493:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:5598:x1876037604477696:12345-192.168.201.39@tcp:33: Request processed in 59633us (74142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129038.860168:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000001:00100000:2.0:1789129038.935146:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00010000:00010000:2.0:1789129039.045863:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129039.169480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129039.171333:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604477952 00000100:00100000:1.0:1789129039.171353:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604477952 00000100:00100000:1.0:1789129039.171461:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1789129039.171476:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:5639:x1876037604477952:12345-192.168.201.39@tcp:101: 00010000:00010000:1.0:1789129039.171503:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129039.171566:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47ce4275 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa7be expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129039.171666:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce427c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129039.171681:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce427c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129039.171692:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce427c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129039.171880:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789129039.171883:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129039.171937:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce427c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129039.171973:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47ce4275 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7be expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129039.172000:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce427c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7be expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129039.172008:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b000) 00010000:00010000:1.0:1789129039.172010:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789129039.172013:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657200, rc 0) 00000100:00100000:1.0:1789129039.172149:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:5639:x1876037604477952:12345-192.168.201.39@tcp:101: Request processed in 676us (2691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129039.172156:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00010000:00010000:1.0:1789129040.069915:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129041.093947:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129041.883925:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129041.886538:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604478080 00000100:00100000:2.0:1789129041.886587:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604478080 00000100:00100000:2.0:1789129041.886735:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00080000:1.0:1789129041.886758:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129041.886761:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:5691:x1876037604478080:12345-192.168.201.39@tcp:41: 00000004:00000024:2.0:1789129041.886833:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789129041.886946:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:5691:x1876037604478080:12345-192.168.201.39@tcp:41: Request processed in 199us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129041.886956:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789129041.897072:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129041.897209:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604478208 00000100:00100000:1.0:1789129041.897231:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604478208 00000100:00100000:0.0:1789129041.897778:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789129041.897792:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382100780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:5691:x1876037604478208:12345-192.168.201.39@tcp:13: 00002000:00000024:0.0:1789129041.897858:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129041.897986:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382100780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:5691:x1876037604478208:12345-192.168.201.39@tcp:13: Request processed in 188us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129041.897997:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789129041.902318:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00080000:1.0:1789129041.902547:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129041.903243:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604478336 00000100:00100000:0.0:1789129041.903263:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604478336 00000100:00100000:0.0:1789129041.903381:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789129041.903397:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:5691:x1876037604478336:12345-192.168.201.39@tcp:13: 00002000:00000024:0.0:1789129041.903522:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129041.903697:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:5691:x1876037604478336:12345-192.168.201.39@tcp:13: Request processed in 304us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129041.903709:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00080000:1.0:1789129041.903985:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789129042.119795:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129042.182557:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626520448:0@lo:13: 00000100:00100000:0.0:1789129042.182708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129042.183003:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626520448 00000100:00100000:2.0:1789129042.183015:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626520448 00000100:00100000:2.0:1789129042.183111:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789129042.183127:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382100f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626520448:12345-0@lo:13: 00002000:00000024:2.0:1789129042.183159:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129042.183223:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382100f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626520448:12345-0@lo:13: Request processed in 103us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129042.183231:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789129042.183287:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780da40 x1876037626520448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129042.183308:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626520448:0@lo:13: 00000100:00080000:0.0:1789129042.184355:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789129042.255126:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00010000:00010000:1.0:1789129043.142190:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789129043.325634:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00000100:00100000:0.0:1789129043.725232:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3821021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626520832:0@lo:400: 00000100:00100000:0.0:1789129043.725329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129043.725426:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129043.725434:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626520960:0@lo:400: 00000100:00100000:0.0:1789129043.725464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129043.725510:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626520832 00000100:00100000:0.0:1789129043.725517:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626520832 00000100:00100000:0.0:1789129043.725580:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789129043.725591:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626520832:12345-0@lo:400: 00000100:00100000:3.0:1789129043.725877:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3821012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626520704:0@lo:400: 00000100:00100000:3.0:1789129043.725912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129043.725934:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626521216:0@lo:400: 00000100:00100000:3.0:1789129043.725957:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129043.725977:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789129043.725983:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382102d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626520576:0@lo:400: 00000100:00100000:3.0:1789129043.726019:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129043.726047:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626521088:0@lo:400: 00000100:00100000:3.0:1789129043.726072:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129043.726109:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626520704 00000100:00100000:3.0:1789129043.726113:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626520704 00000100:00100000:3.0:1789129043.726132:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626521088 00000100:00100000:3.0:1789129043.726135:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626521088 00000100:00100000:3.0:1789129043.726151:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789129043.726158:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626520704:12345-0@lo:400: 00000100:00100000:3.0:1789129043.726211:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626520704:12345-0@lo:400: Request processed in 53us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129043.726218:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789129043.726236:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789129043.726242:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626521088:12345-0@lo:400: 00000100:00100000:3.0:1789129043.726283:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626521088:12345-0@lo:400: Request processed in 42us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129043.726289:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789129043.726306:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626520960 00000100:00100000:3.0:1789129043.726310:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626520960 00000100:00100000:3.0:1789129043.726331:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626521216 00000100:00100000:3.0:1789129043.726334:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626521216 00000100:00100000:3.0:1789129043.726363:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789129043.726370:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626520960:12345-0@lo:400: 00000100:00100000:3.0:1789129043.726407:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626520960:12345-0@lo:400: Request processed in 38us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129043.726413:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789129043.726424:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789129043.726430:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626521216:12345-0@lo:400: 00000100:00100000:3.0:1789129043.726456:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626521216:12345-0@lo:400: Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129043.726462:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789129043.726510:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626521088:0@lo:400: 00000100:00100000:3.0:1789129043.726523:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3821012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626520704:0@lo:400: 00010000:00080000:3.0:1789129043.726534:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498b22940 x1876037626521216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129043.726545:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626521216:0@lo:400: 00010000:00080000:3.0:1789129043.726590:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498b20b40 x1876037626520960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129043.726620:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626520960:0@lo:400: 00000100:00100000:0.0:1789129043.727745:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626520832:12345-0@lo:400: Request processed in 2151us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129043.727757:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789129043.727792:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789129043.727797:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129043.728694:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626520576 00000100:00100000:2.0:1789129043.728705:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626520576 00000100:00100000:2.0:1789129043.728760:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789129043.728770:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626520576:12345-0@lo:400: 00000100:00100000:2.0:1789129043.728853:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626520576:12345-0@lo:400: Request processed in 84us (2832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129043.729027:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789129043.732946:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3821021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626520832:0@lo:400: 00000100:00100000:3.0:1789129043.733032:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382102d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626520576:0@lo:400: 00000100:00100000:3.0:1789129043.736465:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626521344:0@lo:13: 00000100:00100000:3.0:1789129043.736541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129043.736617:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626521344 00000100:00100000:3.0:1789129043.736635:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626521344 00000100:00100000:3.0:1789129043.736682:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789129043.736691:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626521344:12345-0@lo:13: 00002000:00000024:3.0:1789129043.736779:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129043.736828:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626521344:12345-0@lo:13: Request processed in 138us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129043.736835:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789129043.736895:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780e1c0 x1876037626521344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129043.736915:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626521344:0@lo:13: 00000100:00100000:2.0:1789129044.003000:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129044.003043:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129044.003077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129044.003115:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129044.003253:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604478720 00000100:00100000:3.0:1789129044.003264:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604478720 00000100:00100000:3.0:1789129044.003328:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604478848 00000100:00100000:3.0:1789129044.003332:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604478848 00000100:00100000:3.0:1789129044.003350:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1789129044.003359:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604478720:12345-192.168.201.39@tcp:400: 00000100:00100000:3.0:1789129044.003443:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604478720:12345-192.168.201.39@tcp:400: Request processed in 85us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129044.003451:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1789129044.003468:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789129044.003474:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604478848:12345-192.168.201.39@tcp:400: 00000100:00100000:3.0:1789129044.003499:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604478848:12345-192.168.201.39@tcp:400: Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129044.003505:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789129044.003523:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604478592 00000100:00100000:3.0:1789129044.003527:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604478592 00000100:00100000:3.0:1789129044.003556:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:3.0:1789129044.003563:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604478592:12345-192.168.201.39@tcp:400: 00000100:00100000:3.0:1789129044.003589:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604478592:12345-192.168.201.39@tcp:400: Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129044.003596:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00080000:2.0:1789129044.004151:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789129044.004158:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789129044.004160:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129044.009860:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604478464 00000100:00100000:0.0:1789129044.009882:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604478464 00000100:00100000:0.0:1789129044.009970:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:0.0:1789129044.009981:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:2368:x1876037604478464:12345-192.168.201.39@tcp:400: 00000100:00100000:0.0:1789129044.010082:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:2368:x1876037604478464:12345-192.168.201.39@tcp:400: Request processed in 102us (7101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129044.010090:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00010000:00010000:1.0:1789129044.172155:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129045.192056:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789129045.888936:0:8289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789129046.214048:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129047.239638:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129047.301858:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626521472:0@lo:13: 00000100:00100000:3.0:1789129047.301923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129047.302006:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626521472 00000100:00100000:3.0:1789129047.302012:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626521472 00000100:00100000:3.0:1789129047.302072:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789129047.302080:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626521472:12345-0@lo:13: 00002000:00000024:3.0:1789129047.302113:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129047.302151:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626521472:12345-0@lo:13: Request processed in 72us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129047.302158:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789129047.302192:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bad5cf00 x1876037626521472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129047.302210:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626521472:0@lo:13: 00000100:00080000:2.0:1789129047.302256:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789129048.267569:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129048.838037:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626521728:0@lo:400: 00000100:00100000:3.0:1789129048.838177:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129048.838322:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626521600:0@lo:400: 00000100:00100000:0.0:1789129048.838361:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129048.838407:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626522112:0@lo:400: 00000100:00100000:0.0:1789129048.838457:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626521600 00000100:00100000:0.0:1789129048.838464:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626521600 00000100:00100000:0.0:1789129048.838513:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789129048.838522:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626521600:12345-0@lo:400: 00000100:00100000:0.0:1789129048.838587:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626521600:12345-0@lo:400: Request processed in 65us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129048.839269:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789129048.839497:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626522240:0@lo:400: 00000100:00100000:3.0:1789129048.839567:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129048.839729:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626521856:0@lo:400: 00000100:00100000:3.0:1789129048.839756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129048.839773:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626522368:0@lo:13: 00000100:00100000:3.0:1789129048.839794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129048.839810:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129048.839816:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626521984:0@lo:400: 00000100:00100000:3.0:1789129048.839849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129048.839915:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626521728 00000100:00100000:0.0:1789129048.839920:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626521728 00000100:00100000:0.0:1789129048.839951:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626521856 00000100:00100000:0.0:1789129048.839953:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626521856 00000100:00100000:0.0:1789129048.839976:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789129048.839982:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626521728:12345-0@lo:400: 00000100:00100000:0.0:1789129048.840024:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626521728:12345-0@lo:400: Request processed in 42us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129048.840030:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789129048.840040:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789129048.840045:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3821021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626521856:12345-0@lo:400: 00000100:00100000:0.0:1789129048.840067:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3821021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626521856:12345-0@lo:400: Request processed in 22us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129048.840072:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789129048.840086:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129048.843161:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626522368 00000100:00100000:1.0:1789129048.843176:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626522368 00000100:00100000:1.0:1789129048.843263:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789129048.843273:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3821012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626522368:12345-0@lo:13: 00002000:00000024:1.0:1789129048.843326:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129048.843402:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3821012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626522368:12345-0@lo:13: Request processed in 130us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129048.843410:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789129048.843453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129048.843517:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626521600:0@lo:400: 00000100:00080000:0.0:1789129048.844015:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129048.844029:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626522112 00000100:00100000:0.0:1789129048.844033:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626522112 00000100:00100000:0.0:1789129048.844086:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789129048.844094:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626522112:12345-0@lo:400: 00000100:00100000:0.0:1789129048.844147:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626522112:12345-0@lo:400: Request processed in 54us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129048.844155:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789129048.844201:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626522112:0@lo:400: 00000100:00100000:0.0:1789129048.844881:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626521728:0@lo:400: 00000100:00080000:1.0:1789129048.845978:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129048.846491:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626521856:0@lo:400: 00010000:00080000:3.0:1789129048.846510:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780c780 x1876037626522368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129048.846529:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626522368:0@lo:13: 00000100:00100000:2.0:1789129048.847805:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626522240 00000100:00100000:2.0:1789129048.847816:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626522240 00000100:00100000:0.0:1789129048.855789:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626521984 00000100:00100000:0.0:1789129048.855805:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626521984 00000100:00100000:0.0:1789129048.855877:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789129048.855888:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382102d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626522240:12345-0@lo:400: 00000100:00100000:0.0:1789129048.855991:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382102d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626522240:12345-0@lo:400: Request processed in 104us (16423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129048.855999:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789129048.856017:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789129048.856024:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626521984:12345-0@lo:400: 00000100:00100000:0.0:1789129048.856066:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626521984:12345-0@lo:400: Request processed in 43us (16217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129048.856073:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789129048.856121:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bad5c000 x1876037626522240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129048.856136:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626522240:0@lo:400: 00010000:00080000:3.0:1789129048.858344:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bad5cb40 x1876037626521984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129048.858362:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626521984:0@lo:400: 00000100:00100000:1.0:1789129049.117584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129049.117647:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129049.117678:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129049.117703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129049.117730:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604479360 00000100:00100000:1.0:1789129049.117740:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604479360 00000100:00100000:1.0:1789129049.117812:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604479232 00000100:00100000:1.0:1789129049.117816:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604479232 00000100:00100000:1.0:1789129049.117837:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789129049.117847:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604479360:12345-192.168.201.39@tcp:400: 00000100:00100000:1.0:1789129049.117939:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604479360:12345-192.168.201.39@tcp:400: Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129049.117948:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789129049.117966:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1789129049.117973:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604479232:12345-192.168.201.39@tcp:400: 00000100:00100000:1.0:1789129049.118002:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604479232:12345-192.168.201.39@tcp:400: Request processed in 30us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129049.118009:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00080000:1.0:1789129049.118027:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789129049.118046:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129049.119738:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604479104 00000100:00100000:0.0:1789129049.119751:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604479104 00000100:00100000:0.0:1789129049.119824:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789129049.119835:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604479104:12345-192.168.201.39@tcp:400: 00000100:00100000:0.0:1789129049.119908:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604479104:12345-192.168.201.39@tcp:400: Request processed in 65us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129049.119916:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789129049.119939:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604478976 00000100:00100000:0.0:1789129049.119943:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604478976 00000100:00100000:0.0:1789129049.119968:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:0.0:1789129049.119974:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:2367:x1876037604478976:12345-192.168.201.39@tcp:400: 00000100:00100000:0.0:1789129049.120009:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:2367:x1876037604478976:12345-192.168.201.39@tcp:400: Request processed in 34us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129049.120016:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00080000:0.0:1789129049.120055:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789129049.286083:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129050.313788:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789129050.453520:0:8438:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde366ff30 20000000:00000080:0.0:1789129050.453536:0:8438:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b4c0cbe400 uarg=0000000000000000 20000000:01000000:0.0:1789129050.453573:0:8438:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789129050.453576:0:8438:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789129050.453579:0:8438:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789129050.453584:0:8438:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789129050.453589:0:8438:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789129050.453623:0:8438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789129050.453626:0:8438:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789129050.458406:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789129050.458414:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789129050.462744:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789129050.463499:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789129050.463547:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789129050.463575:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789129050.463586:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789129050.463589:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789129050.464918:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789129050.465395:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789129050.465448:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789129050.465477:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1789129050.465487:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789129050.465490:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789129050.467213:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789129050.468319:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789129050.468376:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789129050.468435:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1789129050.468450:0:8438:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789129050.468454:0:8438:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789129050.470284:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789129050.471202:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789129050.471274:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789129050.471314:0:8438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1789129050.471330:0:8438:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789129050.471348:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471372:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b481656200/0x5c74554e47ce4180 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4179 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471381:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b481656000/0x5c74554e47ce41aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce41a3 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471388:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce41d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce41cd expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471395:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b481656a00/0x5c74554e47ce41e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce41db expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471401:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b48151b400/0x5c74554e47ce41f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce41e9 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471408:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b480031c00/0x5c74554e47ce420c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4205 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471415:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b489b86800/0x5c74554e47ce4236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce422f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471425:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b481657600/0x5c74554e47ce4244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa75c expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471433:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b489b87000/0x5c74554e47ce424b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa763 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471441:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471949:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b489b87000/0x5c74554e47ce424b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa763 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.471973:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b489b87000/0x5c74554e47ce424b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa763 expref: 9 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.471991:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626522496:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129050.472105:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b481657600/0x5c74554e47ce4244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa75c expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.472114:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b481657600/0x5c74554e47ce4244 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa75c expref: 9 pid: 5833 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.472123:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626522624:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129050.472151:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b489b86800/0x5c74554e47ce4236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce422f expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.472159:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b489b86800/0x5c74554e47ce4236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce422f expref: 18 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.472170:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626522752:0@lo:104: 00000100:00100000:0.0:1789129050.472211:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789129050.472250:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b480031c00/0x5c74554e47ce420c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4205 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.472257:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b480031c00/0x5c74554e47ce420c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4205 expref: 18 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.472274:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48a172d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626522880:0@lo:104: 00000100:00100000:0.0:1789129050.472295:0:8438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789129050.472324:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b48151b400/0x5c74554e47ce41f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce41e9 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.472332:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b48151b400/0x5c74554e47ce41f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce41e9 expref: 18 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.472340:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626523008:0@lo:104: 00010000:00010000:0.0:1789129050.472365:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b481656a00/0x5c74554e47ce41e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce41db expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.472371:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b481656a00/0x5c74554e47ce41e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce41db expref: 18 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.472378:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626523136:0@lo:104: 00010000:00010000:0.0:1789129050.472398:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce41d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce41cd expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.472405:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce41d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce41cd expref: 18 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.472412:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626523264:0@lo:104: 00010000:00010000:0.0:1789129050.472433:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b481656000/0x5c74554e47ce41aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce41a3 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.472440:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b481656000/0x5c74554e47ce41aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce41a3 expref: 18 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.472457:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626523392:0@lo:104: 00010000:00010000:0.0:1789129050.472479:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b481656200/0x5c74554e47ce4180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4179 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.472486:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b481656200/0x5c74554e47ce4180 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4179 expref: 18 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.472511:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626523520:0@lo:104: 00000100:00100000:0.0:1789129050.472528:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489686180 going to sleep for 11 seconds 00000100:00100000:2.0:1789129050.472982:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789129050.473003:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129050.473019:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129050.473027:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129050.473033:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129050.473041:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129050.473048:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626522752 00000100:00100000:2.0:1789129050.473054:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626522752 00000100:00100000:2.0:1789129050.473093:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626522880 00000100:00100000:2.0:1789129050.473097:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626522880 00000100:00100000:2.0:1789129050.473107:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626523008 00000100:00100000:2.0:1789129050.473110:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626523008 00000100:00100000:2.0:1789129050.473117:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626523136 00000100:00100000:2.0:1789129050.473119:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626523136 00000100:00100000:2.0:1789129050.473127:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626523264 00000100:00100000:2.0:1789129050.473129:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626523264 00000100:00100000:2.0:1789129050.473138:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626523392 00000100:00100000:2.0:1789129050.473140:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626523392 00000100:00100000:2.0:1789129050.473150:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626523520 00000100:00100000:2.0:1789129050.473160:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626523520 00000100:00100000:2.0:1789129050.473177:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789129050.473185:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:8438:x1876037626522752:12345-0@lo:104: 00010000:00010000:2.0:1789129050.473199:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.473257:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789129050.473263:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+9:8438:x1876037626522752:12345-0@lo:104: Request processed in 79us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.473270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789129050.473288:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789129050.473294:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b586f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+8:8438:x1876037626522880:12345-0@lo:104: 00010000:00010000:2.0:1789129050.473301:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.473332:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789129050.473336:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b586f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+8:8438:x1876037626522880:12345-0@lo:104: Request processed in 44us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.473342:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789129050.473374:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789129050.473381:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+7:8438:x1876037626523008:12345-0@lo:104: 00010000:00010000:2.0:1789129050.473388:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.473413:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789129050.473417:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+7:8438:x1876037626523008:12345-0@lo:104: Request processed in 39us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.473422:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789129050.473441:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789129050.473447:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+6:8438:x1876037626523136:12345-0@lo:104: 00010000:00010000:2.0:1789129050.473454:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.473479:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789129050.473484:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+6:8438:x1876037626523136:12345-0@lo:104: Request processed in 39us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.473489:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789129050.473514:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789129050.473520:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:8438:x1876037626523264:12345-0@lo:104: 00010000:00010000:2.0:1789129050.473527:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.473552:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789129050.473557:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:8438:x1876037626523264:12345-0@lo:104: Request processed in 39us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.473562:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789129050.473572:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789129050.473578:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:8438:x1876037626523392:12345-0@lo:104: 00010000:00010000:2.0:1789129050.473584:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.474056:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626522752:0@lo:104: 00000100:00100000:0.0:1789129050.474068:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48a172d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626522880:0@lo:104: 00000100:00100000:0.0:1789129050.474076:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626523008:0@lo:104: 00000100:00100000:0.0:1789129050.474082:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626523136:0@lo:104: 00000100:00100000:0.0:1789129050.474089:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626523264:0@lo:104: 00010000:00010000:2.0:1789129050.474219:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789129050.474225:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:8438:x1876037626523392:12345-0@lo:104: Request processed in 647us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.474233:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789129050.474260:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789129050.474267:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:8438:x1876037626523520:12345-0@lo:104: 00010000:00010000:2.0:1789129050.474276:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474307:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789129050.474312:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:8438:x1876037626523520:12345-0@lo:104: Request processed in 48us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.474318:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789129050.474335:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789129050.474341:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474347:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87800 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129050.474351:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474360:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129050.474367:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129050.474373:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129050.474422:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474429:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129050.474452:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474469:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce422f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4236 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474480:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789129050.474483:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474487:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b800 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129050.474490:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474496:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129050.474513:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129050.474519:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129050.474533:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474539:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129050.474554:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474571:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151b800/0x5c74554e47ce4205 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce420c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474581:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789129050.474590:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.474596:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129050.474598:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.477337:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626523392:0@lo:104: 00000100:00100000:0.0:1789129050.477358:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626523520:0@lo:104: 00000100:00100000:3.0:1789129050.477557:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129050.477578:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626523648:0@lo:103: 00000100:00100000:3.0:1789129050.477681:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789129050.477755:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1789129050.478224:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626523648 00000100:00100000:0.0:1789129050.478231:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626523648 00010000:00010000:0.0:1789129050.478268:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b489b86800/0x5c74554e47ce4236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce422f expref: 19 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.478307:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789129050.478317:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626523648:12345-0@lo:103: 00010000:00010000:0.0:1789129050.478332:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129050.478338:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b489b86800/0x5c74554e47ce4236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce422f expref: 19 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.478360:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b489b86800/0x5c74554e47ce4236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce422f expref: 19 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.478378:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b86800/0x5c74554e47ce4236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce422f expref: 19 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.478395:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129050.478436:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:3306:x1876037626523648:12345-0@lo:103: Request processed in 121us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129050.478444:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789129050.478545:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129050.478553:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129050.478559:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789129050.478584:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626523776:0@lo:103: 00000100:00100000:2.0:1789129050.478652:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129050.479336:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626523776 00000100:00100000:0.0:1789129050.479345:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626523776 00010000:00010000:0.0:1789129050.479371:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b480031c00/0x5c74554e47ce420c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4205 expref: 18 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.479401:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789129050.479408:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:3308:x1876037626523776:12345-0@lo:103: 00010000:00010000:0.0:1789129050.479418:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129050.479422:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b480031c00/0x5c74554e47ce420c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4205 expref: 18 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.479431:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b480031c00/0x5c74554e47ce420c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4205 expref: 18 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.479444:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480031c00/0x5c74554e47ce420c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4205 expref: 18 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.479455:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129050.479510:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3308:x1876037626523776:12345-0@lo:103: Request processed in 103us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129050.479526:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789129050.480133:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626523776:0@lo:103: 00010000:00010000:2.0:1789129050.480187:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.480196:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129050.480209:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.480215:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b489b86600/0x5c74554e47ce41e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41f0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129050.480233:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626523904:0@lo:103: 00000100:00100000:2.0:1789129050.480268:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129050.480324:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626523904 00000100:00100000:2.0:1789129050.480341:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626523904 00010000:00010000:2.0:1789129050.480367:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b48151b400/0x5c74554e47ce41f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce41e9 expref: 17 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129050.480391:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789129050.480399:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3309:x1876037626523904:12345-0@lo:103: 00010000:00010000:2.0:1789129050.480408:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129050.480412:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b48151b400/0x5c74554e47ce41f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce41e9 expref: 17 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.480421:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b48151b400/0x5c74554e47ce41f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce41e9 expref: 17 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.480431:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151b400/0x5c74554e47ce41f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce41e9 expref: 17 pid: 5835 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.480442:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129050.480471:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3309:x1876037626523904:12345-0@lo:103: Request processed in 74us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.480478:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789129050.480502:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626523904:0@lo:103: 00010000:00010000:2.0:1789129050.480518:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789129050.480522:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.480529:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ba00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129050.480532:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.480549:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129050.480556:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129050.480561:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129050.480579:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.480584:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129050.480597:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.481471:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce41cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129050.481509:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789129050.481526:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626524032:0@lo:103: 00000100:00100000:2.0:1789129050.481576:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789129050.481671:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789129050.481676:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.481683:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86a00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129050.481686:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.481696:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129050.481714:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129050.481720:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789129050.481774:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.481781:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129050.481794:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.481801:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b489b86a00/0x5c74554e47ce41a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41aa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129050.481820:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626524160:0@lo:103: 00000100:00100000:0.0:1789129050.481935:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626524032 00000100:00100000:0.0:1789129050.482225:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626524032 00010000:00010000:0.0:1789129050.482257:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce41d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce41cd expref: 16 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.482292:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789129050.482301:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3307:x1876037626524032:12345-0@lo:103: 00010000:00010000:0.0:1789129050.482312:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129050.482317:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce41d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce41cd expref: 16 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.482327:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce41d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce41cd expref: 16 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.482341:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce41d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce41cd expref: 16 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.482355:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129050.482388:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:3307:x1876037626524032:12345-0@lo:103: Request processed in 88us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129050.482394:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789129050.482861:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129050.482871:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.482886:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789129050.482889:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.482908:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129050.482914:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129050.482919:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789129050.483030:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129050.483038:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4a00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129050.483041:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129050.483048:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789129050.483055:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129050.483060:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789129050.483081:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129050.483087:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789129050.483104:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129050.483109:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4829d4a00/0x5c74554e47ce41db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce41e2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129050.483121:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129050.483122:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129050.483124:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129050.483276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129050.483326:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626524032:0@lo:103: 00000100:00100000:2.0:1789129050.483357:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b50b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626524288:0@lo:103: 00000100:00100000:2.0:1789129050.483380:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129050.483409:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626524160 00000100:00100000:2.0:1789129050.483413:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626524160 00010000:00010000:2.0:1789129050.483436:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b481656000/0x5c74554e47ce41aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce41a3 expref: 15 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129050.483450:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626524288 00000100:00100000:2.0:1789129050.483452:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626524288 00010000:00010000:2.0:1789129050.483464:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b481656a00/0x5c74554e47ce41e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce41db expref: 16 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129050.483488:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789129050.483495:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3307:x1876037626524160:12345-0@lo:103: 00010000:00010000:2.0:1789129050.483521:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129050.483525:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b481656000/0x5c74554e47ce41aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce41a3 expref: 16 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.483533:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b481656000/0x5c74554e47ce41aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce41a3 expref: 16 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.483546:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656000/0x5c74554e47ce41aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce41a3 expref: 16 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129050.483564:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129050.483592:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:3307:x1876037626524160:12345-0@lo:103: Request processed in 98us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.483619:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789129050.484047:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789129050.484056:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789129050.484113:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.484120:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789129050.484145:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.484153:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce4179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4180 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.484170:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129050.484172:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129050.484174:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129050.484215:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626524416:0@lo:103: 00000100:00100000:1.0:1789129050.484261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129050.485128:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626524160:0@lo:103: 00000100:00100000:0.0:1789129050.485170:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789129050.485181:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626524416 00000100:00100000:0.0:1789129050.485186:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626524416 00010000:00010000:0.0:1789129050.485212:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b481656200/0x5c74554e47ce4180 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4179 expref: 16 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129050.485483:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626523648:0@lo:103: 00000100:00100000:1.0:1789129050.487034:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129050.488527:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626522496:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129050.488545:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8438:1876037626522624:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129050.488621:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129050.490182:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129050.491081:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604479488 00000100:00100000:0.0:1789129050.491094:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604479488 00010000:00010000:0.0:1789129050.491165:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b489b87000/0x5c74554e47ce424b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa763 expref: 10 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.491188:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604479616 00000100:00100000:0.0:1789129050.491191:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604479616 00010000:00010000:0.0:1789129050.491202:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b481657600/0x5c74554e47ce4244 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa75c expref: 11 pid: 5833 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129050.491217:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789129050.491227:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:3308:x1876037626524288:12345-0@lo:103: 00010000:00010000:0.0:1789129050.491243:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129050.491250:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b481656a00/0x5c74554e47ce41e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce41db expref: 15 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.491261:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b481656a00/0x5c74554e47ce41e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce41db expref: 15 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.491277:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656a00/0x5c74554e47ce41e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce41db expref: 15 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.491303:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129050.491436:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:3308:x1876037626524288:12345-0@lo:103: Request processed in 209us (8053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129050.491446:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789129050.491466:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789129050.491473:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:3309:x1876037626524416:12345-0@lo:103: 00010000:00010000:0.0:1789129050.491481:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129050.491486:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b481656200/0x5c74554e47ce4180 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4179 expref: 13 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.491523:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b481656200/0x5c74554e47ce4180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4179 expref: 13 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.491533:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656200/0x5c74554e47ce4180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4179 expref: 13 pid: 5833 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.491543:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129050.491579:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:3309:x1876037626524416:12345-0@lo:103: Request processed in 107us (7318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129050.491586:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789129050.491665:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789129050.491672:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39f4e36-8626-43c5-a083-60799197f867+11:2370:x1876037604479488:12345-192.168.201.39@tcp:103: 00010000:00010000:0.0:1789129050.491679:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129050.491683:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b489b87000/0x5c74554e47ce424b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa763 expref: 11 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.491693:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b489b87000/0x5c74554e47ce424b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa763 expref: 11 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.491703:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b87000/0x5c74554e47ce424b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa763 expref: 11 pid: 5834 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.491710:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129050.491763:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39f4e36-8626-43c5-a083-60799197f867+10:2370:x1876037604479488:12345-192.168.201.39@tcp:103: Request processed in 91us (4737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129050.491770:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789129050.491784:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1789129050.491790:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39f4e36-8626-43c5-a083-60799197f867+9:2369:x1876037604479616:12345-192.168.201.39@tcp:103: 00010000:00010000:0.0:1789129050.491804:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129050.491809:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b481657600/0x5c74554e47ce4244 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa75c expref: 9 pid: 5833 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.491818:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b481657600/0x5c74554e47ce4244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa75c expref: 9 pid: 5833 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129050.491984:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626524416:0@lo:103: 00010000:00010000:0.0:1789129050.492171:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481657600/0x5c74554e47ce4244 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa75c expref: 9 pid: 5833 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.492192:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.492200:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.492217:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.492222:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.492229:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.492236:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.492242:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129050.492246:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.492265:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.492289:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.492302:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129050.492324:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39f4e36-8626-43c5-a083-60799197f867+8:2369:x1876037604479616:12345-192.168.201.39@tcp:103: Request processed in 534us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129050.492331:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00010000:00010000:1.0:1789129050.493899:0:8438:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129050.493921:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129050.493928:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d4c00/0x5c74554e47ce4283 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.495404:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129050.495413:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129050.495415:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129050.502774:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b50b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626524288:0@lo:103: 00000100:00100000:1.0:1789129050.805385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129050.807334:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604479744 00000100:00100000:3.0:1789129050.807350:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604479744 00000100:00100000:3.0:1789129050.807416:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:3.0:1789129050.807428:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+8:5613:x1876037604479744:12345-192.168.201.39@tcp:101: 00010000:00010000:3.0:1789129050.807455:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129050.807476:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b480030000/0x5c74554e47ce428a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa7c5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129050.807518:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b480030000/0x5c74554e47ce428a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7c5 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129050.807530:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b480030000/0x5c74554e47ce428a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7c5 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129050.807539:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030000, rc 0) 00000100:00100000:3.0:1789129050.807624:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+9:5613:x1876037604479744:12345-192.168.201.39@tcp:101: Request processed in 199us (2251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129050.807633:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:3.0:1789129050.812951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129050.817760:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604479872 00000100:00100000:2.0:1789129050.817781:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604479872 00000100:00100000:2.0:1789129050.817843:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:2.0:1789129050.817854:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+9:5613:x1876037604479872:12345-192.168.201.39@tcp:501: 00000100:00100000:2.0:1789129050.818178:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+9:5613:x1876037604479872:12345-192.168.201.39@tcp:501: Request processed in 325us (5236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.818186:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:0.0:1789129050.827413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129050.828126:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604480000 00000100:00100000:2.0:1789129050.828140:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604480000 00000100:00100000:2.0:1789129050.828207:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:2.0:1789129050.828218:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+9:5613:x1876037604480000:12345-192.168.201.39@tcp:503: 00000100:00100000:2.0:1789129050.828467:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+9:5613:x1876037604480000:12345-192.168.201.39@tcp:503: Request processed in 249us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129050.828476:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:2.0:1789129050.839778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129050.842509:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604480128 00000100:00100000:3.0:1789129050.842528:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604480128 00000100:00100000:3.0:1789129050.842640:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:3.0:1789129050.842651:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+9:6080:x1876037604480128:12345-192.168.201.39@tcp:502: 00000100:00100000:3.0:1789129050.842997:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+9:6080:x1876037604480128:12345-192.168.201.39@tcp:502: Request processed in 346us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129050.843006:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:2.0:1789129050.851708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129050.851795:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604480256 00000100:00100000:0.0:1789129050.851805:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604480256 00000100:00100000:0.0:1789129050.851863:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:0.0:1789129050.851894:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+9:6080:x1876037604480256:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789129050.852176:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+9:6080:x1876037604480256:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 293us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129050.852185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:3.0:1789129050.860085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129050.869732:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604480384 00000100:00100000:0.0:1789129050.869747:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604480384 00000100:00100000:0.0:1789129050.869809:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:0.0:1789129050.869829:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+9:5613:x1876037604480384:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789129050.869848:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129050.869905:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce4291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa7cc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.869936:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce4291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7cc expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.869948:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce4291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7cc expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129050.869957:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4200, rc 0) 00000100:00100000:0.0:1789129050.870022:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:5613:x1876037604480384:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 194us (9951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129050.870030:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:3.0:1789129050.881553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129050.881720:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604480512 00000100:00100000:1.0:1789129050.881732:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604480512 00000100:00100000:1.0:1789129050.881810:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:1.0:1789129050.881831:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:5613:x1876037604480512:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129050.882135:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:5613:x1876037604480512:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 315us (592us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789129050.882143:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 141 00010000:00010000:1.0:1789129051.333961:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789129052.294096:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789129052.294111:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b3812fb000 from 39 10000000:01000000:2.0:1789129052.294121:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789129052.294217:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.294232:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.294244:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129052.294277:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626524544:0@lo:101: 00000100:00100000:2.0:1789129052.294398:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.294490:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c061d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129052.294915:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626524544 00000100:00100000:0.0:1789129052.294929:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626524544 00000100:00100000:0.0:1789129052.295008:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789129052.295021:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+12:5837:x1876037626524544:12345-0@lo:101: 00010000:00010000:0.0:1789129052.295043:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129052.295067:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4829d4e00/0x5c74554e47ce429f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4298 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129052.295106:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d4e00/0x5c74554e47ce429f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4298 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129052.295122:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4829d4e00/0x5c74554e47ce429f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4298 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129052.295134:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4e00, rc 0) 00000100:00100000:0.0:1789129052.295220:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626524544:12345-0@lo:101: Request processed in 201us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129052.295250:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789129052.296150:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626524544:0@lo:101: 00010000:00010000:2.0:1789129052.296201:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.296217:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129052.296334:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626524672:0@lo:501: 00000100:00100000:2.0:1789129052.296422:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.296487:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c061d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129052.296978:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626524672 00000100:00100000:0.0:1789129052.296990:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626524672 00000100:00100000:0.0:1789129052.297067:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789129052.297080:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626524672:12345-0@lo:501: 00000100:00100000:0.0:1789129052.299235:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626524672:12345-0@lo:501: Request processed in 2146us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129052.299252:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789129052.299676:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626524672:0@lo:501: 00000100:00100000:2.0:1789129052.299751:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626524800:0@lo:503: 00000100:00100000:2.0:1789129052.299836:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.299887:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c061d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789129052.310597:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626524800 00000100:00100000:1.0:1789129052.310672:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626524800 00000100:00100000:1.0:1789129052.310781:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789129052.310795:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626524800:12345-0@lo:503: 00000100:00100000:1.0:1789129052.311247:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:5837:x1876037626524800:12345-0@lo:503: Request processed in 453us (11409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129052.311267:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789129052.313088:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626524800:0@lo:503: 00000100:00100000:3.0:1789129052.318946:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8458:1876037626524928:0@lo:502: 00000100:00100000:3.0:1789129052.319119:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129052.319186:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129052.319568:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626524928 00000100:00100000:1.0:1789129052.319581:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626524928 00000100:00100000:1.0:1789129052.319728:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789129052.319742:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:8458:x1876037626524928:12345-0@lo:502: 00000100:00100000:1.0:1789129052.320183:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:8458:x1876037626524928:12345-0@lo:502: Request processed in 442us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129052.320204:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789129052.321556:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8458:1876037626524928:0@lo:502: 00000100:00100000:3.0:1789129052.321703:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8458:1876037626525056:0@lo:502: 00000100:00100000:3.0:1789129052.321816:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129052.321880:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129052.323209:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626525056 00000100:00100000:1.0:1789129052.323224:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626525056 00000100:00100000:1.0:1789129052.325728:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789129052.325786:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+13:8458:x1876037626525056:12345-0@lo:502: 00000100:00100000:3.0:1789129052.326738:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8458:1876037626525056:0@lo:502: 00000040:00080000:3.0:1789129052.326802:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789129052.326934:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789129052.326969:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789129052.326985:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.326997:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129052.327008:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789129052.327012:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789129052.327015:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789129052.327067:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.327090:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.327102:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129052.327126:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626525184:0@lo:101: 00000100:00100000:3.0:1789129052.338137:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.338221:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626525184 00000100:00100000:3.0:1789129052.338239:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.338240:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626525184 00000100:00100000:2.0:1789129052.338446:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789129052.338465:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626525184:12345-0@lo:101: 00010000:00010000:2.0:1789129052.338483:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129052.338501:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b86600/0x5c74554e47ce42ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce42a6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.338531:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b86600/0x5c74554e47ce42ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce42a6 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.338544:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b86600/0x5c74554e47ce42ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce42a6 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.338553:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86600, rc 0) 00000100:00100000:2.0:1789129052.338664:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626525184:12345-0@lo:101: Request processed in 202us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.338669:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789129052.338858:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626525184:0@lo:101: 00010000:00010000:3.0:1789129052.338876:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.338884:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129052.338939:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626525312:0@lo:501: 00000100:00100000:3.0:1789129052.338966:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129052.338986:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626525312 00000100:00100000:3.0:1789129052.338989:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626525312 00000100:00100000:3.0:1789129052.339005:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789129052.339009:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626525312:12345-0@lo:501: 00000100:00100000:3.0:1789129052.339266:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626525312:12345-0@lo:501: Request processed in 255us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129052.339273:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789129052.339305:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129052.339327:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626525312:0@lo:501: 00000100:00100000:3.0:1789129052.339353:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626525440:0@lo:503: 00000100:00100000:3.0:1789129052.339390:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129052.339409:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626525440 00000100:00100000:3.0:1789129052.339413:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626525440 00000100:00100000:3.0:1789129052.339434:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789129052.339439:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626525440:12345-0@lo:503: 00000100:00100000:3.0:1789129052.339753:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626525440:12345-0@lo:503: Request processed in 314us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129052.339758:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789129052.339799:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129052.339822:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626525440:0@lo:503: 00000100:00100000:3.0:1789129052.340065:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8460:1876037626525568:0@lo:502: 00000100:00100000:3.0:1789129052.340101:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129052.340122:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626525568 00000100:00100000:3.0:1789129052.340127:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626525568 00000100:00100000:3.0:1789129052.340145:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789129052.340151:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8460:x1876037626525568:12345-0@lo:502: 00000100:00100000:3.0:1789129052.340267:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8460:x1876037626525568:12345-0@lo:502: Request processed in 115us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129052.340274:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789129052.340305:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d480 going to sleep for 11 seconds 00000100:00100000:3.0:1789129052.340533:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8460:1876037626525568:0@lo:502: 00000020:01000000:3.0:1789129052.340555:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789129052.340564:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129052.340567:0:8460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789129052.340573:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789129052.340599:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8460:1876037626525696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129052.340661:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129052.340680:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.340756:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626525696 00000100:00100000:2.0:1789129052.340760:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626525696 00000100:00100000:2.0:1789129052.340799:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789129052.340807:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8460:x1876037626525696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129052.340985:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8460:x1876037626525696:12345-0@lo:502:llog_process_th.0 Request processed in 176us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.340992:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789129052.341085:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8460:1876037626525696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789129052.341104:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129052.341114:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129052.341116:0:8460:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789129052.341120:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789129052.341266:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789129052.341286:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789129052.341295:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129052.341544:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:8458:x1876037626525056:12345-0@lo:502: Request processed in 15776us (19717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129052.341560:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00010000:00010000:2.0:1789129052.341816:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129052.341904:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789129052.341908:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b492084000 from 39 10000000:01000000:3.0:1789129052.341911:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789129052.341950:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.341957:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.341966:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129052.341983:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626525824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789129052.342025:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129052.342082:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.342116:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626525824 00000100:00100000:2.0:1789129052.342120:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626525824 00000100:00100000:3.0:1789129052.342209:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789129052.342215:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:5837:x1876037626525824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129052.342224:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129052.342233:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b480030400/0x5c74554e47ce42bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce42b4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.342254:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b480030400/0x5c74554e47ce42bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce42b4 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.342264:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b480030400/0x5c74554e47ce42bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce42b4 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.342273:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030400, rc 0) 00000100:00100000:3.0:1789129052.342391:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626525824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129052.342398:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789129052.342589:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626525824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789129052.342675:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129052.342692:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129052.342791:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626525952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129052.348746:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129052.348824:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883fc000 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.349203:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626525952 00000100:00100000:2.0:1789129052.349217:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626525952 00000100:00100000:2.0:1789129052.349289:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789129052.349300:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626525952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.349679:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626525952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.349687:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789129052.351010:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626525952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129052.351133:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626526080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129052.351254:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129052.351319:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626526080 00000100:00100000:1.0:1789129052.351322:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883fc000 going to sleep for 11 seconds 00000100:00100000:3.0:1789129052.351333:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626526080 00000100:00100000:3.0:1789129052.351403:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789129052.351415:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626526080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129052.351723:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626526080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 309us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129052.351734:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789129052.352038:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626526080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129052.352967:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8462:1876037626526208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129052.353058:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129052.353127:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883fc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129052.356221:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626526208 00000100:00100000:3.0:1789129052.356245:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626526208 00000100:00100000:3.0:1789129052.356338:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789129052.356361:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8462:x1876037626526208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129052.357044:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8462:x1876037626526208:12345-0@lo:502:llog_process_th.0 Request processed in 682us (3982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129052.357058:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789129052.357811:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8462:1876037626526208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129052.357917:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8462:1876037626526336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129052.357990:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129052.358033:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883fc9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789129052.358208:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129052.359222:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626526336 00000100:00100000:3.0:1789129052.359242:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626526336 00000100:00100000:3.0:1789129052.359329:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789129052.359354:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8462:x1876037626526336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129052.360114:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:8462:x1876037626526336:12345-0@lo:502:llog_process_th.0 Request processed in 768us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129052.360128:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789129052.360334:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8462:1876037626526336:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789129052.360387:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789129052.360568:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789129052.360785:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789129052.360802:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.360830:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129052.360850:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789129052.360854:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789129052.360858:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789129052.360909:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.360918:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.360930:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129052.360963:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626526464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789129052.361043:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129052.362407:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c0613c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129052.370336:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626526464 00000100:00100000:0.0:1789129052.370513:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626526464 00000100:00100000:3.0:1789129052.370759:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789129052.370775:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:5837:x1876037626526464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129052.370799:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129052.370858:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce42c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce42c2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.370902:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce42c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce42c2 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.370918:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce42c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce42c2 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.370939:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2e00, rc 0) 00000100:00100000:3.0:1789129052.371048:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626526464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 277us (10004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129052.371057:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789129052.392937:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626526464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129052.393125:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129052.393144:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129052.394538:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626526592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129052.394789:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129052.394863:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c0613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.396948:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626526592 00000100:00100000:2.0:1789129052.396967:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626526592 00000100:00100000:2.0:1789129052.397076:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789129052.397090:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626526592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.401312:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626526592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4208us (6508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.401332:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789129052.402888:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626526592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789129052.402987:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626526720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129052.403095:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129052.403145:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0b43540 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.406570:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626526720 00000100:00100000:2.0:1789129052.406584:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626526720 00000100:00100000:2.0:1789129052.408794:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789129052.408822:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626526720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.410235:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626526720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1411us (7126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.410253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789129052.411113:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626526720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129052.415810:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8464:1876037626526848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129052.415960:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129052.416015:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883fc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129052.416222:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626526848 00000100:00100000:0.0:1789129052.416231:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626526848 00000100:00100000:0.0:1789129052.416296:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789129052.416308:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:8464:x1876037626526848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129052.416644:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:8464:x1876037626526848:12345-0@lo:502:llog_process_th.0 Request processed in 337us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129052.416664:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789129052.416944:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8464:1876037626526848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789129052.416983:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789129052.416995:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129052.416998:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789129052.417012:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789129052.417038:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8464:1876037626526976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129052.417073:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129052.417117:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883fc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.417160:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626526976 00000100:00100000:2.0:1789129052.417166:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626526976 00000100:00100000:2.0:1789129052.417207:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789129052.417216:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:8464:x1876037626526976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129052.417377:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:8464:x1876037626526976:12345-0@lo:502:llog_process_th.0 Request processed in 162us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.417386:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789129052.418563:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8464:1876037626526976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789129052.418622:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789129052.418632:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129052.418634:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789129052.418644:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789129052.420861:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789129052.420919:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789129052.420936:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.420951:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129052.420966:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789129052.420970:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b4921dd800 from 39 10000000:01000000:2.0:1789129052.420973:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789129052.421032:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.421041:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.421072:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129052.421105:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626527104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.421212:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.421278:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626527104 00000100:00100000:2.0:1789129052.421287:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626527104 00000100:00100000:2.0:1789129052.421366:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789129052.421376:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626527104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129052.421394:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129052.421409:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b86a00/0x5c74554e47ce42d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce42d0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.421438:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b86a00/0x5c74554e47ce42d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce42d0 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.421451:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b86a00/0x5c74554e47ce42d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce42d0 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.421460:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86a00, rc 0) 00000100:00100000:2.0:1789129052.421501:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626527104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.421509:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789129052.421554:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.421579:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626527104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129052.421596:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.421639:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129052.423630:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626527232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.424273:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.424365:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789129052.430814:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626527360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129052.430941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129052.431022:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626527360 00000100:00100000:1.0:1789129052.431032:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626527360 00000100:00100000:1.0:1789129052.431112:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789129052.431125:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626527360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789129052.431176:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129052.431243:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626527360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129052.431251:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789129052.431278:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129052.431318:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bad5cb40 x1876037626527360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129052.431342:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626527360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789129052.432261:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626527232 00000100:00100000:0.0:1789129052.432273:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626527232 00000100:00100000:2.0:1789129052.432971:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789129052.432988:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626527232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.436408:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626527232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3414us (12126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.436424:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789129052.438580:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626527232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.438685:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626527488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.438774:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.438911:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626527488 00000100:00100000:2.0:1789129052.438918:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626527488 00000100:00100000:2.0:1789129052.438969:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789129052.438980:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626527488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.439218:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626527488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.439227:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789129052.441129:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.441168:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626527488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.442051:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8466:1876037626527616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129052.442138:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.442186:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129052.442249:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626527616 00000100:00100000:0.0:1789129052.442257:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626527616 00000100:00100000:0.0:1789129052.442305:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789129052.442390:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:8466:x1876037626527616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129052.442784:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:8466:x1876037626527616:12345-0@lo:502:llog_process_th.0 Request processed in 395us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.442794:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789129052.442970:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8466:1876037626527616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129052.443041:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8466:1876037626527744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129052.443105:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.443142:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626527744 00000100:00100000:2.0:1789129052.443149:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626527744 00000100:00100000:0.0:1789129052.443160:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0b43900 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.443215:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789129052.443227:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:8466:x1876037626527744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129052.443654:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:8466:x1876037626527744:12345-0@lo:502:llog_process_th.0 Request processed in 429us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.443664:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789129052.443870:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8466:1876037626527744:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789129052.443922:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789129052.444992:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789129052.445474:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789129052.445493:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.445510:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129052.445523:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789129052.445527:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789129052.445531:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789129052.445592:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.446060:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.446084:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129052.446121:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626527872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.446223:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.446435:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129052.446484:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626527872 00000100:00100000:0.0:1789129052.446495:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626527872 00000100:00100000:0.0:1789129052.447390:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789129052.447406:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626527872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789129052.447429:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129052.447452:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4829d5400/0x5c74554e47ce42e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce42de expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129052.447490:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d5400/0x5c74554e47ce42e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce42de expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129052.447503:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4829d5400/0x5c74554e47ce42e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce42de expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129052.447515:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5400, rc 0) 00000100:00100000:0.0:1789129052.447677:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626527872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 275us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129052.447698:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789129052.447829:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626527872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129052.447860:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.447872:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129052.447978:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626528000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.448033:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.448063:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626528000 00000100:00100000:2.0:1789129052.448068:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626528000 00000100:00100000:2.0:1789129052.448105:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789129052.448112:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626528000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.448572:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626528000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 459us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.448582:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789129052.448718:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.448735:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626528000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.448776:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626528128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.448824:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.448858:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626528128 00000100:00100000:2.0:1789129052.448863:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626528128 00000100:00100000:2.0:1789129052.448888:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789129052.448896:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626528128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.449190:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626528128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 294us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.449197:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789129052.449230:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.449348:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626528128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129052.450133:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8468:1876037626528256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129052.450196:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129052.450322:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883fc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.450357:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626528256 00000100:00100000:2.0:1789129052.450363:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626528256 00000100:00100000:2.0:1789129052.450440:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789129052.450451:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8468:x1876037626528256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129052.450737:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8468:x1876037626528256:12345-0@lo:502:llog_process_th.0 Request processed in 287us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.450746:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789129052.450867:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8468:1876037626528256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789129052.450901:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789129052.450915:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129052.450925:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789129052.450941:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789129052.450970:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8468:1876037626528384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129052.451015:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129052.451527:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883fc240 going to sleep for 11 seconds 00000100:00100000:0.0:1789129052.451562:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626528384 00000100:00100000:0.0:1789129052.451569:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626528384 00000100:00100000:0.0:1789129052.451682:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789129052.451693:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8468:x1876037626528384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129052.451995:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8468:x1876037626528384:12345-0@lo:502:llog_process_th.0 Request processed in 302us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129052.452153:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8468:1876037626528384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789129052.452185:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789129052.452192:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129052.452194:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789129052.452204:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789129052.452492:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789129052.452525:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789129052.452542:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.452555:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129052.452569:0:5837:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789129052.452573:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90b487c73490 from 1 10000000:01000000:2.0:1789129052.452585:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789129052.452662:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87600/0x5c74554e47ce42ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.452671:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b489b87600/0x5c74554e47ce42ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.452684:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b489b87600/0x5c74554e47ce42ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129052.452708:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626528512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.452762:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.452806:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626528512 00000100:00100000:2.0:1789129052.452812:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626528512 00000100:00100000:2.0:1789129052.452862:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789129052.452873:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626528512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129052.452893:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129052.452913:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b87200/0x5c74554e47ce42f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce42ec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.452951:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b87200/0x5c74554e47ce42f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce42ec expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.452966:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b87200/0x5c74554e47ce42f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce42ec expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.452976:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87200, rc 0) 00000100:00100000:2.0:1789129052.453149:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+20:5837:x1876037626528512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129052.453157:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789129052.453363:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.453381:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626528512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129052.453396:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b489b87600/0x5c74554e47ce42ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42f3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.453408:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b489b87600/0x5c74554e47ce42ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42f3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129052.453470:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626528640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.453507:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129052.453531:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626528640 00000100:00100000:2.0:1789129052.453535:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626528640 00000100:00100000:2.0:1789129052.453562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789129052.453570:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+20:5837:x1876037626528640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129052.453992:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+20:5837:x1876037626528640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 422us (483us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789129052.454077:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789129052.454114:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129052.454127:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626528640:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789129052.454155:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789129052.454164:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87600/0x5c74554e47ce42ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42f3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129052.454173:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b489b87600/0x5c74554e47ce42ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42f3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129052.454587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00010000:00010000:0.0:1789129053.386124:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789129053.425091:0:8499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1065e400 20000000:00000080:0.0:1789129053.425118:0:8499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b3810dcc00 uarg=0000000000000000 20000000:01000000:0.0:1789129053.425170:0:8499:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789129053.425178:0:8499:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789129053.425185:0:8499:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789129053.428989:0:8500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789129053.429120:0:8499:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789129053.445054:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789129053.445106:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789129053.445164:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789129053.446479:0:8499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789129053.446503:0:8499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.446523:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b48151a000/0x5c74554e47ce406f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4068 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.446532:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b481656e00/0x5c74554e47ce40d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce40ca expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.446539:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b48151b000/0x5c74554e47ce419c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4195 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.446563:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce4259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa794 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.446571:0:8499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.446628:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce4259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa794 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.446644:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce4259 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa794 expref: 9 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129053.446659:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1876037626528768:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129053.446783:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b48151b000/0x5c74554e47ce419c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4195 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.446793:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b48151b000/0x5c74554e47ce419c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4195 expref: 18 pid: 5833 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129053.446802:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1876037626528896:0@lo:104: 00000100:00100000:0.0:1789129053.446854:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789129053.446890:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b481656e00/0x5c74554e47ce40d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce40ca expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.446898:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b481656e00/0x5c74554e47ce40d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce40ca expref: 18 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129053.446907:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1876037626529024:0@lo:104: 00000100:00100000:0.0:1789129053.446940:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789129053.446971:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b48151a000/0x5c74554e47ce406f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4068 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.446979:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b48151a000/0x5c74554e47ce406f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4068 expref: 18 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129053.446988:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1876037626529152:0@lo:104: 00000100:00100000:0.0:1789129053.447010:0:8499:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0b43480 going to sleep for 11 seconds 00000100:00100000:3.0:1789129053.447065:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789129053.447112:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129053.447139:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626528896 00000100:00100000:3.0:1789129053.447147:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626528896 00000100:00100000:3.0:1789129053.447200:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626529024 00000100:00100000:3.0:1789129053.447203:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626529024 00000100:00100000:3.0:1789129053.447214:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626529152 00000100:00100000:3.0:1789129053.447217:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626529152 00000100:00100000:3.0:1789129053.447234:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789129053.447244:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:8499:x1876037626528896:12345-0@lo:104: 00010000:00010000:3.0:1789129053.447266:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.447382:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789129053.447389:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:8499:x1876037626528896:12345-0@lo:104: Request processed in 147us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129053.447397:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789129053.447423:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789129053.447432:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7828c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:8499:x1876037626529024:12345-0@lo:104: 00010000:00010000:3.0:1789129053.447442:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129053.447936:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1876037626528896:0@lo:104: 00000100:00100000:0.0:1789129053.447949:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1876037626529024:0@lo:104: 00010000:00010000:0.0:1789129053.449698:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129053.449787:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.449799:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5000 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789129053.449804:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.449814:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129053.449836:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129053.449842:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789129053.449912:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.449920:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789129053.449967:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.449975:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4829d5000/0x5c74554e47ce4195 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce419c expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.449994:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129053.449996:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129053.449998:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129053.450008:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626529280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129053.450731:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789129053.450749:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7828c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:8499:x1876037626529024:12345-0@lo:104: Request processed in 3315us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129053.450764:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789129053.450849:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789129053.450864:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:8499:x1876037626529152:12345-0@lo:104: 00010000:00010000:3.0:1789129053.450883:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b481656800/0x5c74554e47ce4068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.450991:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789129053.451000:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:8499:x1876037626529152:12345-0@lo:104: Request processed in 140us (3888us total) trans 0 rc 0/0 00010000:00010000:2.0:1789129053.451238:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789129053.451258:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.451269:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87e00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129053.451273:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.451293:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129053.451301:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129053.451307:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789129053.451344:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129053.451346:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789129053.451358:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789129053.451391:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129053.451400:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b481656800/0x5c74554e47ce4068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.451402:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.451434:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce40ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce40d1 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.451447:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129053.451450:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129053.451456:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656800 already unused, calling callback (ffffffffc1c28c20) 00010000:00010000:2.0:1789129053.451457:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1789129053.451467:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b481656800/0x5c74554e47ce4068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129053.451471:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789129053.451487:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b481656800/0x5c74554e47ce4068 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789129053.451499:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b481656800/0x5c74554e47ce4068 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129053.451500:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626529408:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789129053.451523:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789129053.451533:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1876037626529152:0@lo:104: 00010000:00010000:3.0:1789129053.451558:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b481656800/0x5c74554e47ce4068 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.451568:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789129053.451584:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b481656800/0x5c74554e47ce4068 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129053.451596:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.451672:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626529536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789129053.451707:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.451734:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626529408 00000100:00100000:2.0:1789129053.451739:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626529408 00010000:00010000:2.0:1789129053.451766:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b481656e00/0x5c74554e47ce40d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce40ca expref: 19 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129053.451803:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626529536 00000100:00100000:2.0:1789129053.451806:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626529536 00010000:00010000:3.0:1789129053.451819:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b481656800/0x5c74554e47ce4068 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce406f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.451833:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b48151a000/0x5c74554e47ce406f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4068 expref: 20 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129053.451877:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789129053.451887:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129053.451890:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+20:3309:x1876037626529408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129053.451893:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129053.451898:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129053.451907:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129053.451916:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b481656e00/0x5c74554e47ce40d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce40ca expref: 20 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129053.451953:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789129053.451965:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+20:3309:x1876037626529536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129053.451979:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129053.451988:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b48151a000/0x5c74554e47ce406f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4068 expref: 20 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.452009:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b48151a000/0x5c74554e47ce406f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4068 expref: 20 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.452030:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151a000/0x5c74554e47ce406f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4068 expref: 20 pid: 5834 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.452048:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129053.452109:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626529536:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129053.452117:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789129053.452155:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b481656e00/0x5c74554e47ce40d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce40ca expref: 18 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.452177:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656e00/0x5c74554e47ce40d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce40ca expref: 18 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129053.452202:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626529536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789129053.452203:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129053.452303:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3309:x1876037626529408:12345-0@lo:103:ldlm_bl.0 Request processed in 415us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129053.452313:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789129053.452349:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626529408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789129053.455595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129053.455854:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604480640 00000100:00100000:3.0:1789129053.455866:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604480640 00010000:00010000:3.0:1789129053.455912:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce4259 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa794 expref: 10 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129053.455952:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1789129053.455964:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+10:2370:x1876037604480640:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129053.455981:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129053.455988:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce4259 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa794 expref: 10 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.456019:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce4259 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa794 expref: 10 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.456044:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129053.456134:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+10:2370:x1876037604480640:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 147us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129053.456142:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00010000:00010000:0.0:1789129053.456792:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d5800/0x5c74554e47ce4259 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa794 expref: 9 pid: 5834 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129053.456809:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1876037626528768:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129053.456852:0:8499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129053.457246:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129053.457591:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626529280 00000100:00100000:3.0:1789129053.457630:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626529280 00010000:00010000:3.0:1789129053.457663:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b48151b000/0x5c74554e47ce419c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4195 expref: 17 pid: 5833 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129053.457696:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789129053.457705:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3307:x1876037626529280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129053.457720:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129053.457725:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b48151b000/0x5c74554e47ce419c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4195 expref: 17 pid: 5833 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457735:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b48151b000/0x5c74554e47ce419c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4195 expref: 17 pid: 5833 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457751:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151b000/0x5c74554e47ce419c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4195 expref: 17 pid: 5833 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457767:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457776:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457805:0:8444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457812:0:8444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457819:0:8444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457838:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457844:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129053.457849:0:8444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457857:0:8444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457870:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129053.457879:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129053.457925:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3307:x1876037626529280:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129053.457932:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789129053.458011:0:8499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.458019:0:8499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.458025:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d4600/0x5c74554e47ce42fa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129053.458914:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626529280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789129053.958059:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626529792:0@lo:400:kworker.0 00000100:00100000:0.0:1789129053.958151:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129053.958225:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626530304:0@lo:400:kworker.0 00000100:00100000:0.0:1789129053.958277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129053.958318:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789129053.958325:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626529664:0@lo:400:kworker.0 00000100:00100000:0.0:1789129053.958359:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129053.958381:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626530176:0@lo:400:kworker.0 00000100:00100000:0.0:1789129053.958403:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129053.958438:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626529792 00000100:00100000:0.0:1789129053.958447:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626529792 00000100:00100000:0.0:1789129053.958506:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626530176 00000100:00100000:0.0:1789129053.958509:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626530176 00000100:00100000:0.0:1789129053.958549:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789129053.958560:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626529792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129053.959897:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626529792:12345-0@lo:400:kworker.0 Request processed in 1330us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129053.959913:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789129053.959952:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789129053.959966:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626530176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129053.960010:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626530176:12345-0@lo:400:kworker.0 Request processed in 51us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129053.960017:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789129053.960041:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626530304 00000100:00100000:0.0:1789129053.960048:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626530304 00000100:00100000:0.0:1789129053.960088:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789129053.960096:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626530304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129053.960129:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626530304:12345-0@lo:400:kworker.0 Request processed in 35us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129053.960146:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789129053.960174:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789129053.960180:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129053.960245:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626530176:0@lo:400:kworker.0 00000100:00100000:0.0:1789129053.960261:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626529792:0@lo:400:kworker.0 00010000:00080000:0.0:1789129053.960298:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6c3c0 x1876037626530304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129053.960310:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626530304:0@lo:400:kworker.0 10000000:01000000:2.0:1789129053.960454:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789129053.960460:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b3812fb000 from 4 10000000:01000000:2.0:1789129053.960465:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789129053.960519:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.960542:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.960556:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129053.960580:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626530432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.960665:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.960697:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.960744:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626529664 00000100:00100000:2.0:1789129053.960749:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626529664 00000100:00100000:2.0:1789129053.960783:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626530432 00000100:00100000:2.0:1789129053.960787:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626530432 00000100:00100000:2.0:1789129053.960801:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789129053.960808:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3307:x1876037626529664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129053.960859:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3307:x1876037626529664:12345-0@lo:400:kworker.0 Request processed in 52us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.960867:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789129053.960891:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789129053.960898:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626530432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129053.960907:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129053.960921:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b86c00/0x5c74554e47ce4308 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4301 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.960946:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b86c00/0x5c74554e47ce4308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4301 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.960971:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b86c00/0x5c74554e47ce4308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4301 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.960983:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86c00, rc 0) 00000100:00100000:2.0:1789129053.961010:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626530432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.961017:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789129053.961053:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626530432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129053.961068:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.961078:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129053.961145:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626530688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.961171:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.961185:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.961196:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626530688 00000100:00100000:2.0:1789129053.961199:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626530688 00000100:00100000:2.0:1789129053.961219:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789129053.961226:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626530688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.961561:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626530688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.961569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789129053.961639:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626529664:0@lo:400:kworker.0 00000100:00100000:2.0:1789129053.961682:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626530688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.961717:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626530816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.961763:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.961785:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.961796:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626530816 00000100:00100000:2.0:1789129053.961799:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626530816 00000100:00100000:2.0:1789129053.961835:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789129053.961841:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626530816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.962015:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626530816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.962022:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789129053.962055:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626530816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.962330:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8514:1876037626530944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129053.962363:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.962379:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626530944 00000100:00100000:2.0:1789129053.962382:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626530944 00000100:00100000:2.0:1789129053.962401:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789129053.962407:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:8514:x1876037626530944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129053.962531:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:8514:x1876037626530944:12345-0@lo:502:llog_process_th.0 Request processed in 123us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.962538:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789129053.962562:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.962572:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8514:1876037626530944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129053.962593:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129053.962632:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129053.962635:0:8514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789129053.962643:0:8514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b3812fb000 00000020:00000080:2.0:1789129053.962646:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789129053.962723:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8514:1876037626531072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129053.962752:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.962768:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626531072 00000100:00100000:2.0:1789129053.962771:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626531072 00000100:00100000:2.0:1789129053.962789:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789129053.962794:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:8514:x1876037626531072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129053.962903:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:8514:x1876037626531072:12345-0@lo:502:llog_process_th.0 Request processed in 108us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.962909:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789129053.962940:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.962950:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8514:1876037626531072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129053.962964:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129053.962968:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129053.962970:0:8514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789129053.962973:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789129053.963033:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789129053.963051:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789129053.963061:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.963072:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129053.963083:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789129053.963086:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b492084000 from 4 10000000:01000000:2.0:1789129053.963095:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789129053.963123:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.963133:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.963144:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129053.963157:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626531200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.963183:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.963195:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.963206:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626531200 00000100:00100000:2.0:1789129053.963209:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626531200 00000100:00100000:2.0:1789129053.963230:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789129053.963236:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626531200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129053.963245:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129053.963259:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b87c00/0x5c74554e47ce4316 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce430f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.963280:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b87c00/0x5c74554e47ce4316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce430f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.963291:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b87c00/0x5c74554e47ce4316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce430f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.963300:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87c00, rc 0) 00000100:00100000:2.0:1789129053.963326:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626531200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.963341:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789129053.963384:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626531200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129053.963396:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.963406:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129053.963447:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626531328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.963471:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.963483:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.963492:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626531328 00000100:00100000:2.0:1789129053.963495:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626531328 00000100:00100000:2.0:1789129053.963512:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789129053.963518:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626531328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.963762:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626531328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.963770:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789129053.963797:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626531328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129053.965199:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626529920:0@lo:400:kworker.0 00000100:00100000:3.0:1789129053.965277:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129053.965313:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626530560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129053.965350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129053.965375:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789129053.965381:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626530048:0@lo:400:kworker.0 00000100:00100000:3.0:1789129053.965403:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129053.966067:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626530048 00000100:00100000:0.0:1789129053.966080:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626530048 00000100:00100000:0.0:1789129053.966149:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789129053.966163:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626530048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129053.966172:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626530560 00000100:00100000:1.0:1789129053.966177:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626530560 00000100:00100000:1.0:1789129053.966225:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789129053.966234:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626530560:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129053.966293:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626530048:12345-0@lo:400:kworker.0 Request processed in 134us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129053.966302:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789129053.966346:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626529920 00000100:00100000:0.0:1789129053.966350:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626529920 00002000:00000024:1.0:1789129053.966363:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129053.966390:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789129053.966397:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626529920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129053.966403:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626530560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129053.966409:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789129053.966427:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626529920:12345-0@lo:400:kworker.0 Request processed in 31us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129053.966433:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789129053.966440:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789129053.966483:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6da40 x1876037626530048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129053.966498:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626530048:0@lo:400:kworker.0 00000100:00100000:0.0:1789129053.966521:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626529920:0@lo:400:kworker.0 00010000:00080000:0.0:1789129053.966531:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b497af3480 x1876037626530560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129053.966547:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626530560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129053.967247:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626531456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.967441:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.967491:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789129053.967703:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626531456 00000100:00100000:0.0:1789129053.967722:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626531456 00000100:00100000:0.0:1789129053.967793:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789129053.967809:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626531456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129053.968102:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626531456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129053.968111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789129053.968200:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626531456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.971569:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8515:1876037626531584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129053.971727:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.971773:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789129053.972007:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626531584 00000100:00100000:0.0:1789129053.972017:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626531584 00000100:00100000:0.0:1789129053.972080:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789129053.972092:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8515:x1876037626531584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129053.972353:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8515:x1876037626531584:12345-0@lo:502:llog_process_th.0 Request processed in 262us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129053.972362:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789129053.973337:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8515:1876037626531584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129053.973383:0:8515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129053.973394:0:8515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129053.973396:0:8515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789129053.973403:0:8515:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b492084000 00000020:00000080:2.0:1789129053.973406:0:8515:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789129053.973498:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8515:1876037626531712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129053.973560:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.973632:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789129053.973955:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626531712 00000100:00100000:0.0:1789129053.973962:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626531712 00000100:00100000:0.0:1789129053.974015:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789129053.974024:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8515:x1876037626531712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129053.974225:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:8515:x1876037626531712:12345-0@lo:502:llog_process_th.0 Request processed in 201us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129053.974233:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789129053.979655:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8515:1876037626531712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129053.979728:0:8515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129053.979744:0:8515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129053.979747:0:8515:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789129053.979753:0:8515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789129053.979995:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789129053.980016:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789129053.980027:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.980038:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129053.980052:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789129053.980055:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4921dd800 from 4 10000000:01000000:0.0:1789129053.980058:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789129053.980098:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.980107:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129053.980117:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129053.980142:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626531840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789129053.980208:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129053.980261:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0b43f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.981025:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626531840 00000100:00100000:2.0:1789129053.981033:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626531840 00000100:00100000:2.0:1789129053.981078:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789129053.981087:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626531840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129053.981101:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129053.981118:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b87400/0x5c74554e47ce4324 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce431d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.981146:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b87400/0x5c74554e47ce4324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce431d expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.981157:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b87400/0x5c74554e47ce4324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce431d expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.981178:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87400, rc 0) 00000100:00100000:2.0:1789129053.981230:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626531840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.981238:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789129053.981285:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626531840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129053.981300:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.981310:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129053.981364:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626531968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.981390:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.981406:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.981418:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626531968 00000100:00100000:2.0:1789129053.981422:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626531968 00000100:00100000:2.0:1789129053.981456:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789129053.981463:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626531968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.981738:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626531968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.981745:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789129053.981774:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626531968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.981803:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626532096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.981855:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.981875:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.981887:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626532096 00000100:00100000:2.0:1789129053.981890:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626532096 00000100:00100000:2.0:1789129053.981911:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789129053.981917:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626532096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.982062:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626532096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.982069:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789129053.982105:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626532096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129053.982283:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8517:1876037626532224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129053.982317:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.982336:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626532224 00000100:00100000:2.0:1789129053.982339:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626532224 00000100:00100000:2.0:1789129053.982361:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789129053.982368:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:8517:x1876037626532224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129053.982484:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:8517:x1876037626532224:12345-0@lo:502:llog_process_th.0 Request processed in 116us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.982491:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789129053.982519:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.982530:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8517:1876037626532224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129053.982551:0:8517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129053.982560:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129053.982562:0:8517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789129053.982569:0:8517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b4921dd800 00000020:00000080:2.0:1789129053.982572:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789129053.982654:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8517:1876037626532352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129053.982693:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129053.982712:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626532352 00000100:00100000:2.0:1789129053.982716:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626532352 00000100:00100000:2.0:1789129053.982736:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789129053.982742:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:8517:x1876037626532352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129053.982857:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:8517:x1876037626532352:12345-0@lo:502:llog_process_th.0 Request processed in 114us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129053.982864:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789129053.982891:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4857ccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129053.982902:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af2d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:8517:1876037626532352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129053.982919:0:8517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129053.982922:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129053.982924:0:8517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789129053.982927:0:8517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789129053.982974:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789129053.982989:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789129053.982997:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129053.983006:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129054.237731:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129054.237790:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129054.237839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129054.237905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604480896 00000100:00100000:0.0:1789129054.237916:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604480896 00000100:00100000:0.0:1789129054.238006:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:0.0:1789129054.238017:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604480896:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:2.0:1789129054.238031:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129054.238104:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604480896:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 89us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129054.238112:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:1.0:1789129054.238284:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604481024 00000100:00100000:1.0:1789129054.238289:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604481024 00000100:00100000:1.0:1789129054.238348:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789129054.238356:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2369:x1876037604481024:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129054.238402:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2369:x1876037604481024:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 46us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129054.238409:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00080000:0.0:1789129054.238720:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129054.239024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604480768 00000100:00100000:3.0:1789129054.239030:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604480768 00000100:00100000:3.0:1789129054.239079:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:3.0:1789129054.239087:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+9:2369:x1876037604480768:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129054.239139:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+9:2369:x1876037604480768:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 53us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129054.239147:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:2.0:1789129054.245485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129054.245705:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604481152 00000100:00100000:0.0:1789129054.245718:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604481152 00000100:00100000:0.0:1789129054.245804:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789129054.245825:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2370:x1876037604481152:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129054.245899:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2370:x1876037604481152:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 77us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129054.245907:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00080000:2.0:1789129054.246551:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789129054.409176:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129055.260376:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129055.260496:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604481280 00000100:00100000:2.0:1789129055.260513:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604481280 00000100:00100000:2.0:1789129055.260659:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:2.0:1789129055.260674:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+9:5613:x1876037604481280:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129055.260700:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129055.260734:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b86000/0x5c74554e47ce432b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa7d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129055.260779:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b86000/0x5c74554e47ce432b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7d3 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129055.260802:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b86000/0x5c74554e47ce432b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7d3 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129055.260815:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86000, rc 0) 00000100:00100000:2.0:1789129055.260897:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:5613:x1876037604481280:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 227us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129055.260907:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:3.0:1789129055.264076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129055.264342:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604481408 00000100:00100000:2.0:1789129055.264357:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604481408 00000100:00100000:2.0:1789129055.264513:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:2.0:1789129055.264531:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:5613:x1876037604481408:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129055.265343:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:5613:x1876037604481408:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 813us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129055.265355:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:1.0:1789129055.269131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129055.269590:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604481536 00000100:00100000:2.0:1789129055.269621:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604481536 00000100:00100000:2.0:1789129055.269695:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:2.0:1789129055.269714:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:5613:x1876037604481536:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129055.270142:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:5613:x1876037604481536:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 426us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129055.270152:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:2.0:1789129055.278040:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129055.278563:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604481664 00000100:00100000:0.0:1789129055.278588:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604481664 00000100:00100000:0.0:1789129055.278931:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:0.0:1789129055.278961:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:6144:x1876037604481664:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789129055.280149:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:6144:x1876037604481664:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 1186us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129055.280170:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:2.0:1789129055.293650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129055.293710:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604481792 00000100:00100000:0.0:1789129055.293734:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604481792 00000100:00100000:0.0:1789129055.293876:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:0.0:1789129055.293899:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:6144:x1876037604481792:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789129055.294369:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:6144:x1876037604481792:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 471us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129055.294386:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 195 00010000:00010000:3.0:1789129055.432541:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129056.463711:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129057.478183:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129057.543798:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626532480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129057.543905:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129057.544592:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626532480 00000100:00100000:1.0:1789129057.544621:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626532480 00000100:00100000:1.0:1789129057.544709:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789129057.544719:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626532480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789129057.544774:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129057.565481:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626532480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 20750us (21562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129057.565499:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789129057.565691:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789129057.578990:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b575c000 x1876037626532480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129057.579030:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626532480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789129058.503121:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129059.078987:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626532608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129059.079073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129059.079166:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626533120:0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129059.079227:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789129059.079233:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626532736:0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129059.079288:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626533248:0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129059.079340:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626532864:0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079362:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129059.079380:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626533376:0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129059.079412:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789129059.079417:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626532992:0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129059.079468:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626533120 00000100:00100000:0.0:1789129059.079476:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626533120 00000100:00100000:0.0:1789129059.079526:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626533376 00000100:00100000:0.0:1789129059.079529:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626533376 00000100:00100000:0.0:1789129059.079552:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789129059.079560:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626533120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079634:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626533120:12345-0@lo:400:kworker.0 Request processed in 74us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129059.079642:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789129059.079659:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789129059.079666:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626533376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079697:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626533376:12345-0@lo:400:kworker.0 Request processed in 32us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129059.079710:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789129059.079742:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626532736 00000100:00100000:0.0:1789129059.079746:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626532736 00000100:00100000:0.0:1789129059.079767:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789129059.079774:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626532736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079803:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626532736:12345-0@lo:400:kworker.0 Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129059.079809:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789129059.079837:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626533248 00000100:00100000:0.0:1789129059.079840:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626533248 00000100:00100000:0.0:1789129059.079863:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626532864 00000100:00100000:0.0:1789129059.079865:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626532864 00000100:00100000:0.0:1789129059.079874:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626532992 00000100:00100000:0.0:1789129059.079876:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626532992 00000100:00100000:0.0:1789129059.079888:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789129059.079894:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626533248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079921:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626533248:12345-0@lo:400:kworker.0 Request processed in 27us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129059.079926:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789129059.079935:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789129059.079941:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626532864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.079967:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626532864:12345-0@lo:400:kworker.0 Request processed in 26us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129059.079973:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789129059.079982:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789129059.079988:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626532992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.080020:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626532992:12345-0@lo:400:kworker.0 Request processed in 32us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129059.080026:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789129059.080077:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626532992:0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.080088:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626532864:0@lo:400:kworker.0 00010000:00080000:0.0:1789129059.080099:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6c780 x1876037626533376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129059.080110:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626533376:0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.080240:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626532736:0@lo:400:kworker.0 00000100:00100000:0.0:1789129059.080249:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626533248:0@lo:400:kworker.0 00010000:00080000:0.0:1789129059.080260:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6ed00 x1876037626533120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129059.080268:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626533120:0@lo:400:kworker.0 00000100:00080000:0.0:1789129059.082590:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789129059.082625:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789129059.082628:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129059.082757:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626532608 00000100:00100000:2.0:1789129059.082769:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626532608 00000100:00100000:2.0:1789129059.082847:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789129059.082859:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626532608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129059.082914:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129059.083016:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626532608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (3943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129059.083026:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789129059.083139:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6da40 x1876037626532608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129059.083163:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626532608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129059.355659:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129059.355727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129059.355759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129059.355785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129059.355811:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604482176 00000100:00100000:1.0:1789129059.355820:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604482176 00000100:00100000:3.0:1789129059.356021:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604481920 00000100:00100000:3.0:1789129059.356026:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604481920 00000100:00100000:3.0:1789129059.356064:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:3.0:1789129059.356075:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:2368:x1876037604481920:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129059.356163:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:2368:x1876037604481920:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 90us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129059.356173:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:1.0:1789129059.356254:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604482304 00000100:00100000:1.0:1789129059.356371:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604482304 00000100:00100000:1.0:1789129059.356461:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1789129059.356472:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604482176:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129059.356500:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604482176:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129059.356506:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1789129059.356528:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1789129059.356534:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604482304:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129059.356553:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604482304:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 20us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129059.356559:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1789129059.356574:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604482048 00000100:00100000:1.0:1789129059.356577:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604482048 00000100:00100000:1.0:1789129059.356624:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1789129059.356631:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604482048:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129059.356655:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604482048:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129059.356661:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00080000:1.0:1789129059.357357:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789129059.357364:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789129059.357366:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789129059.526034:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129060.549832:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789129061.412824:0:8798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789129061.574099:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129062.606849:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129062.665370:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789129062.665410:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626533504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129062.665544:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129062.665725:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626533504 00000100:00100000:2.0:1789129062.665739:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626533504 00000100:00100000:2.0:1789129062.665836:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789129062.665853:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626533504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129062.665913:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129062.665971:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626533504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129062.665980:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789129062.666408:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789129062.666578:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b575d2c0 x1876037626533504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129062.666648:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626533504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789129063.623785:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129064.206541:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626533632:0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.206696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129064.206764:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626534144:0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.206796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129064.206828:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789129064.206835:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626533760:0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.206862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129064.206881:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626534272:0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.206928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129064.206964:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626534016:0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.206993:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129064.207016:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129064.207022:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626533888:0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.207044:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129064.207078:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626534144 00000100:00100000:0.0:1789129064.207087:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626534144 00000100:00100000:0.0:1789129064.207151:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626533760 00000100:00100000:0.0:1789129064.207155:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626533760 00000100:00100000:0.0:1789129064.207169:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626533888 00000100:00100000:0.0:1789129064.207172:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626533888 00000100:00100000:0.0:1789129064.207189:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789129064.207199:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626534144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.207265:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626534144:12345-0@lo:400:kworker.0 Request processed in 66us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129064.207274:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789129064.207293:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789129064.207299:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626533760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.207339:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626533760:12345-0@lo:400:kworker.0 Request processed in 41us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129064.207346:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789129064.207358:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789129064.207364:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626533888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.207396:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626533888:12345-0@lo:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129064.207402:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789129064.207458:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626533888:0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.207494:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626533760:0@lo:400:kworker.0 00000100:00100000:0.0:1789129064.207505:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626534144:0@lo:400:kworker.0 00000100:00100000:2.0:1789129064.207713:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626533632 00000100:00100000:2.0:1789129064.207718:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626533632 00000100:00100000:2.0:1789129064.207954:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789129064.207963:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626533632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129064.208015:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626533632:12345-0@lo:400:kworker.0 Request processed in 54us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129064.208022:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:2.0:1789129064.208057:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129064.208252:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626533632:0@lo:400:kworker.0 00000100:00100000:1.0:1789129064.209144:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626534272 00000100:00100000:1.0:1789129064.209153:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626534272 00000100:00100000:1.0:1789129064.209211:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626534016 00000100:00100000:1.0:1789129064.209216:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626534016 00000100:00100000:1.0:1789129064.209240:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789129064.209250:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626534272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129064.209344:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626534272:12345-0@lo:400:kworker.0 Request processed in 96us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129064.209351:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789129064.209367:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789129064.209374:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626534016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129064.209410:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626534016:12345-0@lo:400:kworker.0 Request processed in 37us (2415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129064.209432:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789129064.209465:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789129064.209468:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789129064.209510:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6c780 x1876037626534016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129064.209526:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626534016:0@lo:400:kworker.0 00000100:00100000:1.0:1789129064.209547:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789129064.209557:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626534400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129064.209649:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129064.209687:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626534400 00000100:00100000:1.0:1789129064.209691:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626534400 00000100:00100000:1.0:1789129064.209721:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789129064.209728:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626534400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129064.209766:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129064.209806:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626534400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129064.209812:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789129064.209840:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bad5fc00 x1876037626534400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129064.209858:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626534400:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789129064.209887:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6d680 x1876037626534272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129064.209897:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626534272:0@lo:400:kworker.0 00000100:00100000:3.0:1789129064.480863:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129064.485119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129064.485167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129064.485218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129064.485267:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604482432 00000100:00100000:3.0:1789129064.485289:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604482432 00000100:00100000:3.0:1789129064.485356:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:3.0:1789129064.485369:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:2370:x1876037604482432:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129064.485468:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:2370:x1876037604482432:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 101us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129064.485477:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:1.0:1789129064.486170:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604482560 00000100:00100000:1.0:1789129064.486189:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604482560 00000100:00100000:1.0:1789129064.486310:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1789129064.486321:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604482560:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129064.486377:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604482560:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 59us (5531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129064.486385:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1789129064.486410:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604482688 00000100:00100000:1.0:1789129064.486415:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604482688 00000100:00080000:3.0:1789129064.494186:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789129064.494204:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129064.498783:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604482816 00000100:00100000:1.0:1789129064.498806:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604482816 00000100:00100000:0.0:1789129064.501527:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789129064.501555:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2366:x1876037604482688:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:0.0:1789129064.501649:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4267 00000100:00080000:0.0:1789129064.501664:0:6686:0:(import.c:65:import_set_state_nolock()) ffff90b4a7805000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789129064.501756:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789129064.502327:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+2:2366:x1876037604482688:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 779us (17155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129064.502341:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00010000:00010000:2.0:1789129064.502929:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789129064.509354:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789129064.509568:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:1.0:1789129064.509614:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2366:x1876037604482816:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:1.0:1789129064.509887:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce426e 00000100:00080000:1.0:1789129064.509906:0:6688:0:(import.c:65:import_set_state_nolock()) ffff90b4a7803000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789129064.509985:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789129064.510488:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+2:2366:x1876037604482816:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 895us (25267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129064.510501:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00010000:00010000:0.0:1789129064.510702:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129064.649590:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789129064.796966:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:3.0:1789129064.796983:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b4a7800800/9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:0.0:1789129064.797092:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7800800/9463e625-4f12-4089-85aa-d90aafb8e5a9 for lustre-OST0001 00000020:00000080:0.0:1789129064.797182:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4a7803000 for lustre-OST0001 00010000:00010000:0.0:1789129065.677346:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129066.704264:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129067.726301:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129067.785052:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626534528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129067.785176:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129067.785276:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626534528 00000100:00100000:1.0:1789129067.785287:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626534528 00000100:00100000:1.0:1789129067.785357:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789129067.785369:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626534528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789129067.785426:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129067.785485:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626534528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129067.785501:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789129067.785528:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129067.785583:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bad5fc00 x1876037626534528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129067.785630:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626534528:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789129067.863544:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:3.0:1789129067.863555:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b4a7800000/9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:2.0:1789129067.863680:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7800000/9463e625-4f12-4089-85aa-d90aafb8e5a9 for lustre-OST0000 00000020:00000080:2.0:1789129067.863740:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4a7805000 for lustre-OST0000 00000001:02000400:2.0:1789129068.579744:0:9043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing yml_node 00010000:00010000:2.0:1789129068.743507:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129069.318834:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626534784:0@lo:400:kworker.0 00000100:00100000:2.0:1789129069.318917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129069.318986:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626535296:0@lo:400:kworker.0 00000100:00100000:2.0:1789129069.319018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129069.319055:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789129069.319062:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626534656:0@lo:400:kworker.0 00000100:00100000:2.0:1789129069.319089:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129069.319116:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626535168:0@lo:400:kworker.0 00000100:00100000:2.0:1789129069.319138:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129069.319169:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626535296 00000100:00100000:2.0:1789129069.319176:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626535296 00000100:00100000:2.0:1789129069.319231:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789129069.319241:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626535296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129069.319303:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626535296:12345-0@lo:400:kworker.0 Request processed in 64us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129069.319311:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789129069.319341:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626534656 00000100:00100000:2.0:1789129069.319345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626534656 00000100:00100000:2.0:1789129069.319374:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789129069.319381:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626534656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129069.319411:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626534656:12345-0@lo:400:kworker.0 Request processed in 30us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129069.319417:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789129069.319470:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626534656:0@lo:400:kworker.0 00010000:00080000:2.0:1789129069.319493:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902fa940 x1876037626535296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129069.319521:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626535296:0@lo:400:kworker.0 00000100:00100000:1.0:1789129069.319791:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626534912:0@lo:400:kworker.0 00000100:00100000:1.0:1789129069.319828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129069.319853:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129069.319859:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626535040:0@lo:400:kworker.0 00000100:00100000:1.0:1789129069.319882:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129069.319915:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626534784 00000100:00100000:1.0:1789129069.319920:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626534784 00000100:00100000:1.0:1789129069.319948:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626535168 00000100:00100000:1.0:1789129069.319952:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626535168 00000100:00100000:1.0:1789129069.319965:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626534912 00000100:00100000:1.0:1789129069.319968:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626534912 00000100:00100000:1.0:1789129069.319983:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789129069.319990:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626534784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129069.320030:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626534784:12345-0@lo:400:kworker.0 Request processed in 40us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129069.320037:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789129069.320050:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789129069.320056:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626535168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129069.320085:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626535168:12345-0@lo:400:kworker.0 Request processed in 30us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129069.320091:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789129069.320112:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789129069.320118:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3827483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626534912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129069.320151:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3827483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626534912:12345-0@lo:400:kworker.0 Request processed in 33us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129069.320157:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789129069.320173:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789129069.320177:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789129069.320186:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626535040 00000100:00100000:1.0:1789129069.320190:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626535040 00000100:00100000:1.0:1789129069.320218:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789129069.320224:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626535040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129069.320254:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626535040:12345-0@lo:400:kworker.0 Request processed in 31us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129069.320261:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789129069.320332:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902fa580 x1876037626535040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129069.320343:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626535040:0@lo:400:kworker.0 00000100:00100000:1.0:1789129069.320353:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626534912:0@lo:400:kworker.0 00000100:00080000:1.0:1789129069.320369:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129069.322268:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626535168:0@lo:400:kworker.0 00000100:00100000:0.0:1789129069.322288:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626534784:0@lo:400:kworker.0 00000100:00100000:1.0:1789129069.325126:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626535424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129069.325203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129069.325261:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626535424 00000100:00100000:1.0:1789129069.325269:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626535424 00000100:00100000:1.0:1789129069.325312:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789129069.325320:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626535424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129069.325356:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129069.325406:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626535424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129069.325414:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789129069.325455:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780e1c0 x1876037626535424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129069.325474:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626535424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129069.595548:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129069.595635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129069.595723:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604482944 00000100:00100000:3.0:1789129069.595739:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604482944 00000100:00100000:3.0:1789129069.595817:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:3.0:1789129069.595829:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:2367:x1876037604482944:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129069.595935:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:2367:x1876037604482944:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 108us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129069.595945:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:1.0:1789129069.596242:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604483072 00000100:00100000:1.0:1789129069.596248:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604483072 00000100:00100000:1.0:1789129069.596302:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:1.0:1789129069.596309:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604483072:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129069.596352:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604483072:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 43us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129069.596358:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00080000:0.0:1789129069.596430:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789129069.770542:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129070.791239:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129071.815478:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129072.838493:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129072.902335:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626535552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129072.902419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129072.902505:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626535552 00000100:00100000:2.0:1789129072.902514:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626535552 00000100:00100000:2.0:1789129072.902582:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789129072.902594:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626535552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129072.902656:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129072.902714:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626535552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129072.902722:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789129072.902728:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129072.902806:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780c780 x1876037626535552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129072.902827:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626535552:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789129073.295903:0:9237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.133 00010000:00010000:1.0:1789129073.862360:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129074.441848:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626535680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129074.441930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129074.442129:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626535680 00000100:00100000:3.0:1789129074.442138:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626535680 00000100:00100000:3.0:1789129074.442216:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789129074.442228:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626535680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789129074.442280:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129074.442350:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626535680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129074.442358:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789129074.444632:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789129074.444698:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b575e1c0 x1876037626535680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129074.444741:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626535680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129074.445825:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626535936:0@lo:400:kworker.0 00000100:00100000:1.0:1789129074.446974:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626536192:0@lo:400:kworker.0 00000100:00100000:1.0:1789129074.447059:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129074.447120:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789129074.447128:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626535808:0@lo:400:kworker.0 00000100:00100000:1.0:1789129074.447156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129074.447181:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626536320:0@lo:400:kworker.0 00000100:00100000:1.0:1789129074.447205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129074.447240:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626536192 00000100:00100000:1.0:1789129074.447247:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626536192 00000100:00100000:1.0:1789129074.447301:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789129074.447311:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626536192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129074.447364:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626536192:12345-0@lo:400:kworker.0 Request processed in 55us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129074.447371:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789129074.447393:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626536320 00000100:00100000:3.0:1789129074.447630:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129074.447654:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789129074.447662:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626536064:0@lo:400:kworker.0 00000100:00100000:3.0:1789129074.447683:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129074.447714:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626535936 00000100:00100000:3.0:1789129074.447718:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626535936 00000100:00100000:3.0:1789129074.447746:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626536064 00000100:00100000:3.0:1789129074.447750:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626536064 00000100:00100000:3.0:1789129074.447765:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789129074.447773:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626535936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129074.447809:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626535936:12345-0@lo:400:kworker.0 Request processed in 37us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129074.447816:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789129074.447828:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789129074.448500:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626536320 00000100:00100000:1.0:1789129074.448639:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789129074.448648:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626536320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129074.448700:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626536320:12345-0@lo:400:kworker.0 Request processed in 54us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129074.448706:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789129074.448728:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789129074.448733:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129074.448767:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626536320:0@lo:400:kworker.0 00010000:00080000:1.0:1789129074.448802:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b575cf00 x1876037626536192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129074.448813:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626536192:0@lo:400:kworker.0 00000100:00100000:3.0:1789129074.449074:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626536064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129074.449119:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626536064:12345-0@lo:400:kworker.0 Request processed in 1285us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129074.449127:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789129074.449159:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626536064:0@lo:400:kworker.0 00000100:00100000:3.0:1789129074.449169:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626535936:0@lo:400:kworker.0 00000100:00100000:2.0:1789129074.453637:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626535808 00000100:00100000:2.0:1789129074.453652:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626535808 00000100:00100000:2.0:1789129074.453718:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789129074.453728:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626535808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129074.454116:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626535808:12345-0@lo:400:kworker.0 Request processed in 390us (6958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129074.454125:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789129074.454243:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626535808:0@lo:400:kworker.0 00000100:00100000:0.0:1789129074.721311:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129074.721373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129074.722129:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604483328 00000100:00100000:1.0:1789129074.722146:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604483328 00000100:00100000:1.0:1789129074.722264:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:1.0:1789129074.722279:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604483328:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129074.722392:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604483328:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 115us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129074.722401:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:2.0:1789129074.723193:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604483200 00000100:00100000:2.0:1789129074.723206:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604483200 00000100:00080000:3.0:1789129074.723211:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129074.723267:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:2.0:1789129074.723278:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:2368:x1876037604483200:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129074.723329:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:2368:x1876037604483200:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 54us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129074.723336:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 203 00010000:00010000:2.0:1789129074.886214:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129075.911579:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789129076.353470:0:9334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.133 00010000:00010000:1.0:1789129076.934797:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129077.975484:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129078.027945:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789129078.027975:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626536448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129078.028078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129078.028161:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626536448 00000100:00100000:2.0:1789129078.028172:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626536448 00000100:00100000:2.0:1789129078.028239:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789129078.028249:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626536448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129078.028297:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129078.028352:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626536448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129078.028361:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789129078.028399:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789129078.028438:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780da40 x1876037626536448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129078.028461:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626536448:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789129078.983412:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129079.558791:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626536576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129079.558865:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129079.558951:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626536576 00000100:00100000:0.0:1789129079.558960:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626536576 00000100:00100000:0.0:1789129079.559017:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789129079.559027:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626536576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789129079.559067:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129079.559113:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626536576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129079.559121:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789129079.559145:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789129079.559181:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902f9e00 x1876037626536576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129079.559201:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626536576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129079.561480:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626536832:0@lo:400:kworker.0 00000100:00100000:0.0:1789129079.561556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129079.561628:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789129079.561635:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626536704:0@lo:400:kworker.0 00000100:00100000:0.0:1789129079.561669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129079.561699:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626537216:0@lo:400:kworker.0 00000100:00100000:0.0:1789129079.561722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129079.561751:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626536704 00000100:00100000:0.0:1789129079.561757:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626536704 00000100:00100000:0.0:1789129079.561802:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789129079.561812:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626536704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129079.561865:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626536704:12345-0@lo:400:kworker.0 Request processed in 54us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129079.561872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789129079.561910:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626536960:0@lo:400:kworker.0 00000100:00100000:0.0:1789129079.561933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129079.561953:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789129079.561958:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626537088:0@lo:400:kworker.0 00000100:00100000:0.0:1789129079.561984:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129079.562011:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626537088 00000100:00100000:0.0:1789129079.562014:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626537088 00000100:00100000:0.0:1789129079.562043:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789129079.562050:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626537088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129079.562085:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626537088:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129079.562092:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1789129079.562126:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b485da3c00 x1876037626537088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129079.562152:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626537088:0@lo:400:kworker.0 00000100:00100000:0.0:1789129079.562185:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626536704:0@lo:400:kworker.0 00000100:00100000:3.0:1789129079.562846:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626536832 00000100:00100000:3.0:1789129079.562853:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626536832 00000100:00100000:3.0:1789129079.562896:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626537216 00000100:00100000:3.0:1789129079.562900:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626537216 00000100:00100000:3.0:1789129079.562923:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626536960 00000100:00100000:3.0:1789129079.562925:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626536960 00000100:00100000:3.0:1789129079.562939:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789129079.562946:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626536832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129079.563006:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626536832:12345-0@lo:400:kworker.0 Request processed in 60us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129079.563013:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789129079.563028:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789129079.563034:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626537216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129079.563063:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626537216:12345-0@lo:400:kworker.0 Request processed in 30us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129079.563070:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789129079.563081:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789129079.563087:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626536960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129079.563117:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626536960:12345-0@lo:400:kworker.0 Request processed in 31us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129079.563124:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789129079.563143:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129079.563170:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626536960:0@lo:400:kworker.0 00000100:00100000:3.0:1789129079.563207:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626537216:0@lo:400:kworker.0 00000100:00100000:3.0:1789129079.563217:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626536832:0@lo:400:kworker.0 00000100:00100000:2.0:1789129079.846529:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129079.846846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129079.846903:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604483584 00000100:00100000:3.0:1789129079.846916:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604483584 00000100:00100000:2.0:1789129079.846971:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604483456 00000100:00100000:2.0:1789129079.846976:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604483456 00000100:00100000:3.0:1789129079.846983:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:3.0:1789129079.846993:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604483584:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129079.847002:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:2.0:1789129079.847008:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:2367:x1876037604483456:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129079.852598:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604483584:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 5592us (6067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129079.852637:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00080000:3.0:1789129079.852674:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129079.857904:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:2367:x1876037604483456:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 10878us (11041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129079.857921:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 205 00010000:00010000:1.0:1789129080.006903:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789129080.089001:0:9432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.133 00010000:00010000:3.0:1789129081.031563:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129082.056836:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789129082.240468:0:9480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 08:18:00 EDT 2026 00010000:00010000:1.0:1789129083.078626:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129083.141820:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626537344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129083.141920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129083.144352:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626537344 00000100:00100000:2.0:1789129083.144374:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626537344 00000100:00100000:2.0:1789129083.144480:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789129083.144493:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626537344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129083.144564:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129083.144695:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626537344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129083.144704:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789129083.144894:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b485da3840 x1876037626537344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129083.144924:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626537344:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789129083.146758:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789129084.107350:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129084.683842:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626537600:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.683920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129084.683975:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626538112:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.683999:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129084.684030:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789129084.684036:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626537472:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129084.684083:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626537984:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684115:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129084.684142:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626537728:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129084.684179:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129084.684184:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626537856:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129084.684234:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626537600 00000100:00100000:3.0:1789129084.684241:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626537600 00000100:00100000:3.0:1789129084.684297:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626537984 00000100:00100000:3.0:1789129084.684301:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626537984 00000100:00100000:3.0:1789129084.684321:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626537728 00000100:00100000:3.0:1789129084.684325:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626537728 00000100:00100000:3.0:1789129084.684342:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789129084.684350:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626537600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684403:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626537600:12345-0@lo:400:kworker.0 Request processed in 52us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129084.684409:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789129084.684425:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789129084.684431:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626537984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684458:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626537984:12345-0@lo:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129084.684464:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789129084.684475:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789129084.684481:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626537728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684510:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626537728:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129084.684516:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789129084.684543:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626538112 00000100:00100000:3.0:1789129084.684547:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626538112 00000100:00100000:3.0:1789129084.684572:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626537856 00000100:00100000:3.0:1789129084.684574:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626537856 00000100:00100000:3.0:1789129084.684587:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789129084.684593:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626538112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684652:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626538112:12345-0@lo:400:kworker.0 Request processed in 60us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129084.684659:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789129084.684669:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789129084.684674:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626537856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684697:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626537856:12345-0@lo:400:kworker.0 Request processed in 23us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129084.684702:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789129084.684720:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626537472 00000100:00100000:3.0:1789129084.684724:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626537472 00000100:00100000:3.0:1789129084.684745:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789129084.684751:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626537472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684777:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626537472:12345-0@lo:400:kworker.0 Request processed in 27us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129084.684783:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1789129084.684820:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789129084.684824:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789129084.684854:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b575cf00 x1876037626537856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129084.684869:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626537856:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684881:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626537728:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684919:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626537472:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684929:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626537984:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.684938:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626537600:0@lo:400:kworker.0 00010000:00080000:3.0:1789129084.684948:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b575e1c0 x1876037626538112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129084.684957:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626538112:0@lo:400:kworker.0 00000100:00100000:3.0:1789129084.688419:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789129084.688445:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626538240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129084.688532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129084.688594:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626538240 00000100:00100000:3.0:1789129084.688628:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626538240 00000100:00100000:3.0:1789129084.688694:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789129084.688705:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626538240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789129084.688754:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129084.688806:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626538240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129084.688813:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789129084.688866:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b498b22940 x1876037626538240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129084.688888:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626538240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129084.976967:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129084.977026:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129084.977063:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604483712 00000100:00100000:1.0:1789129084.977076:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604483712 00000100:00100000:1.0:1789129084.977141:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:1.0:1789129084.977152:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:2368:x1876037604483712:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129084.977258:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:2368:x1876037604483712:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 107us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129084.977292:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:3.0:1789129084.977633:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604483840 00000100:00100000:3.0:1789129084.977638:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604483840 00000100:00100000:3.0:1789129084.977684:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:3.0:1789129084.977691:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604483840:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129084.977735:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604483840:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 45us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129084.977742:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00080000:1.0:1789129084.978363:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789129085.126336:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129086.153336:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129087.174295:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129088.197935:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129088.262590:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626538368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129088.262705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129088.262745:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626538368 00000100:00100000:1.0:1789129088.262753:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626538368 00000100:00080000:3.0:1789129088.262804:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129088.262822:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789129088.263002:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626538368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789129088.263037:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129088.263097:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626538368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 267us (391us total) trans 0 rc 0/0 00010000:00080000:0.0:1789129088.263832:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b485da3480 x1876037626538368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129088.263858:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626538368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129088.285150:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1789129089.224086:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129089.806053:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129089.806076:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626538496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129089.806156:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129089.806243:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626538496 00000100:00100000:0.0:1789129089.806252:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626538496 00000100:00100000:0.0:1789129089.806310:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789129089.806319:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626538496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789129089.806356:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129089.806400:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626538496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129089.806407:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789129089.806438:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789129089.806468:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902f9a40 x1876037626538496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129089.806488:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626538496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129089.807036:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626538752:0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129089.807105:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789129089.807110:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626538880:0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129089.807185:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626538752 00000100:00100000:2.0:1789129089.807189:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626538752 00000100:00100000:2.0:1789129089.807221:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626538880 00000100:00100000:2.0:1789129089.807223:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626538880 00000100:00100000:2.0:1789129089.807246:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789129089.807253:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626538752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807296:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626538752:12345-0@lo:400:kworker.0 Request processed in 43us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129089.807303:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789129089.807317:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789129089.807323:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626538880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807351:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626538880:12345-0@lo:400:kworker.0 Request processed in 28us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129089.807375:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789129089.807405:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626539008:0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129089.807461:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789129089.807467:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626538624:0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129089.807513:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626539136:0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129089.807552:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626539008 00000100:00100000:2.0:1789129089.807555:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626539008 00000100:00100000:2.0:1789129089.807583:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789129089.807589:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626539008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807649:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626539008:12345-0@lo:400:kworker.0 Request processed in 60us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129089.807654:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789129089.807672:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626538624 00000100:00100000:2.0:1789129089.807675:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626538624 00000100:00100000:2.0:1789129089.807698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789129089.807704:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626538624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807730:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626538624:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129089.807736:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:2.0:1789129089.807763:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129089.807786:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626538880:0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807795:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626538752:0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807831:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626538624:0@lo:400:kworker.0 00010000:00080000:2.0:1789129089.807841:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b485da0f00 x1876037626539008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129089.807850:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626539008:0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807864:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626539136 00000100:00100000:2.0:1789129089.807867:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626539136 00000100:00100000:2.0:1789129089.807891:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789129089.807896:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626539136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129089.807928:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626539136:12345-0@lo:400:kworker.0 Request processed in 31us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129089.807933:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789129089.807947:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129089.807960:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626539136:0@lo:400:kworker.0 00000100:00100000:1.0:1789129090.080981:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129090.081042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129090.083275:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604483968 00000100:00100000:3.0:1789129090.083297:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604483968 00000100:00100000:3.0:1789129090.083378:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:3.0:1789129090.083389:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:2369:x1876037604483968:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129090.083484:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+10:2369:x1876037604483968:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 97us (2441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129090.083493:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:2.0:1789129090.084346:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604484096 00000100:00100000:2.0:1789129090.084357:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604484096 00000100:00100000:2.0:1789129090.084413:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:2.0:1789129090.084422:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604484096:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129090.084484:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604484096:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 63us (3518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129090.084491:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00080000:3.0:1789129090.085774:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789129090.267879:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129091.273680:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129092.293963:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129093.317954:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129093.384799:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626539264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129093.384879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129093.384966:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626539264 00000100:00100000:2.0:1789129093.384976:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626539264 00000100:00100000:3.0:1789129093.402230:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789129093.402254:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626539264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129093.402319:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129093.402425:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626539264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (17546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129093.402433:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789129093.402505:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b485da0780 x1876037626539264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129093.402534:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626539264:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789129093.402671:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789129094.341865:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129094.918164:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129094.918292:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789129094.918313:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626539776:0@lo:400:kworker.0 00000100:00100000:0.0:1789129094.918385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129094.918447:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626539648:0@lo:400:kworker.0 00000100:00100000:0.0:1789129094.918476:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129094.918495:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129094.918501:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626539520:0@lo:400:kworker.0 00000100:00100000:0.0:1789129094.918522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129094.920459:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626539392:0@lo:400:kworker.0 00000100:00100000:1.0:1789129094.920533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129094.920572:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789129094.920580:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626539904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129094.920622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129094.920670:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626539904 00000100:00100000:1.0:1789129094.920679:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626539904 00000100:00100000:1.0:1789129094.920748:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789129094.920758:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626539904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129094.920797:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129094.920841:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626539904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129094.920855:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789129094.920899:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902fa1c0 x1876037626539904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129094.920918:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626539904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129094.922794:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626539776 00000100:00100000:1.0:1789129094.922808:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626539776 00000100:00100000:1.0:1789129094.922875:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789129094.922883:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626539776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129094.922970:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626539776:12345-0@lo:400:kworker.0 Request processed in 87us (4585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129094.922977:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789129094.923028:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b485da2d00 x1876037626539776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129094.923049:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626539776:0@lo:400:kworker.0 00000100:00100000:2.0:1789129094.927565:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626540032:0@lo:400:kworker.0 00000100:00100000:2.0:1789129094.927660:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789129094.927662:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789129094.928439:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626539648 00000100:00100000:2.0:1789129094.928449:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626539648 00000100:00100000:2.0:1789129094.928499:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626539520 00000100:00100000:2.0:1789129094.928503:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626539520 00000100:00100000:2.0:1789129094.928515:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626540032 00000100:00100000:2.0:1789129094.928518:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626540032 00000100:00100000:2.0:1789129094.928534:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789129094.928542:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626539648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129094.932043:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789129094.932061:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626539520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129094.932163:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626539520:12345-0@lo:400:kworker.0 Request processed in 107us (13639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129094.932170:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789129094.932196:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789129094.932202:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626540032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129094.932243:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626540032:12345-0@lo:400:kworker.0 Request processed in 42us (4584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129094.932248:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789129094.933519:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626539648:12345-0@lo:400:kworker.0 Request processed in 58us (10121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129094.933536:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789129094.933575:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626539392 00000100:00100000:2.0:1789129094.933583:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626539392 00000100:00100000:2.0:1789129094.933636:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789129094.933644:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626539392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129094.933724:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626539392:12345-0@lo:400:kworker.0 Request processed in 81us (13191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129094.933731:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1789129094.933768:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129094.933805:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626540032:0@lo:400:kworker.0 00000100:00100000:2.0:1789129094.933842:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626539392:0@lo:400:kworker.0 00000100:00100000:2.0:1789129094.933874:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626539520:0@lo:400:kworker.0 00000100:00100000:2.0:1789129094.933887:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626539648:0@lo:400:kworker.0 00000100:00100000:1.0:1789129095.207821:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129095.207882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129095.207984:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604484224 00000100:00100000:2.0:1789129095.207998:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604484224 00000100:00100000:2.0:1789129095.208097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:2.0:1789129095.208109:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:2369:x1876037604484224:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129095.208221:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:2369:x1876037604484224:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 114us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129095.208229:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:3.0:1789129095.208764:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604484352 00000100:00100000:3.0:1789129095.208770:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604484352 00000100:00100000:3.0:1789129095.208830:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:3.0:1789129095.208838:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604484352:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129095.208891:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604484352:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 54us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129095.208898:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00080000:2.0:1789129095.209640:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789129095.370066:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129096.389848:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129097.416920:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129098.438595:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129098.506967:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626540160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129098.507088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129098.508787:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626540160 00000100:00100000:2.0:1789129098.508807:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626540160 00000100:00100000:2.0:1789129098.508920:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789129098.508933:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626540160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129098.508995:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789129098.509185:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129098.511728:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626540160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2781us (4623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129098.511751:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789129098.513072:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b485da0f00 x1876037626540160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129098.513134:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626540160:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789129099.462148:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129100.038191:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789129100.038223:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626540288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129100.038347:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129100.038781:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626540288 00000100:00100000:0.0:1789129100.038791:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626540288 00000100:00100000:0.0:1789129100.038885:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789129100.038897:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626540288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789129100.038961:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789129100.039197:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129100.039289:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626540288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 394us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129100.039300:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789129100.039390:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902fb480 x1876037626540288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129100.039419:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626540288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129100.052903:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626540416:0@lo:400:kworker.0 00000100:00100000:1.0:1789129100.053039:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129100.053442:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626540416 00000100:00100000:2.0:1789129100.053454:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626540416 00000100:00100000:2.0:1789129100.053526:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789129100.053539:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626540416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.061216:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626540416:12345-0@lo:400:kworker.0 Request processed in 7656us (8155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129100.061251:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789129100.061435:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626540544:0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.061511:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129100.061556:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789129100.061564:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626540672:0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.061635:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129100.061666:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626540544 00000100:00100000:2.0:1789129100.061675:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626540544 00000100:00100000:2.0:1789129100.061725:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626540672 00000100:00100000:2.0:1789129100.061728:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626540672 00000100:00100000:2.0:1789129100.061770:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789129100.061782:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626540544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.061847:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626540544:12345-0@lo:400:kworker.0 Request processed in 67us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129100.061855:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789129100.061869:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789129100.061875:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626540672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.061900:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626540672:12345-0@lo:400:kworker.0 Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129100.061906:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1789129100.061965:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129100.062347:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626540800:0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.062386:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129100.062429:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626540800 00000100:00100000:2.0:1789129100.062433:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626540800 00000100:00100000:2.0:1789129100.062470:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789129100.062477:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626540800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.062512:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626540800:12345-0@lo:400:kworker.0 Request processed in 36us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129100.062520:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1789129100.062539:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789129100.062586:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b575e1c0 x1876037626540800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129100.062643:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626540800:0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.062679:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626540672:0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.062690:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626540544:0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.063460:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789129100.063475:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626540928:0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.063528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129100.063579:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626540928 00000100:00100000:2.0:1789129100.063587:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626540928 00000100:00100000:2.0:1789129100.063660:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789129100.063671:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626540928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129100.063719:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626540928:12345-0@lo:400:kworker.0 Request processed in 49us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129100.063726:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789129100.063754:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129100.063779:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626540928:0@lo:400:kworker.0 00000100:00100000:1.0:1789129100.069088:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626540416:0@lo:400:kworker.0 00000100:00100000:1.0:1789129100.315999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129100.316064:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129100.316597:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604484608 00000100:00100000:0.0:1789129100.316651:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604484608 00000100:00100000:0.0:1789129100.316756:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:0.0:1789129100.316770:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604484608:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129100.316891:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604484608:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 123us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129100.316900:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:0.0:1789129100.316962:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604484480 00000100:00100000:0.0:1789129100.316966:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604484480 00000100:00100000:0.0:1789129100.317009:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:0.0:1789129100.317017:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:2367:x1876037604484480:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129100.317045:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+10:2367:x1876037604484480:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 30us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129100.317051:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00080000:1.0:1789129100.317640:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789129100.485910:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789129101.212211:0:10111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:18:18 (1789129098) === 00010000:00010000:2.0:1789129101.509889:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129101.809632:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129101.809775:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604484736 00000100:00100000:2.0:1789129101.809798:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604484736 00000100:00100000:2.0:1789129101.809870:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:2.0:1789129101.809882:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+10:8140:x1876037604484736:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789129101.809903:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129101.809935:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b86e00/0x5c74554e47ce4332 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa7da expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129101.810005:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b86e00/0x5c74554e47ce4332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7da expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129101.810016:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b86e00/0x5c74554e47ce4332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7da expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129101.810025:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86e00, rc 0) 00000100:00100000:2.0:1789129101.810089:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+11:8140:x1876037604484736:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 210us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129101.810098:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:0.0:1789129101.827573:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129101.828709:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604484864 00000100:00100000:2.0:1789129101.828721:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604484864 00000100:00100000:2.0:1789129101.828791:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:2.0:1789129101.828801:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+11:8140:x1876037604484864:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789129101.829520:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+11:8140:x1876037604484864:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 718us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129101.829530:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:1.0:1789129101.832996:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129101.833211:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604484992 00000100:00100000:0.0:1789129101.833224:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604484992 00000100:00100000:0.0:1789129101.833301:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 216 00000100:00100000:0.0:1789129101.833313:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+11:8140:x1876037604484992:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789129101.833674:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+11:8140:x1876037604484992:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 361us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129101.833684:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 216 00000100:00100000:1.0:1789129101.841515:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129101.841649:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604485120 00000100:00100000:2.0:1789129101.841663:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604485120 00000100:00100000:2.0:1789129101.841749:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:2.0:1789129101.841763:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+11:8144:x1876037604485120:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789129101.842241:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+11:8144:x1876037604485120:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 479us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129101.842252:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:1.0:1789129101.876477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129101.877117:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604485248 00000100:00100000:2.0:1789129101.877153:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604485248 00000100:00100000:2.0:1789129101.877227:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:2.0:1789129101.877238:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+11:8144:x1876037604485248:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789129101.877896:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+11:8144:x1876037604485248:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 655us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129101.877907:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:1.0:1789129101.906247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129101.906430:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604485376 00000100:00100000:0.0:1789129101.906444:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604485376 00000100:00100000:0.0:1789129101.906523:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:0.0:1789129101.906536:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+11:8140:x1876037604485376:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789129101.906562:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129101.906649:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4829d5000/0x5c74554e47ce4339 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa804 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129101.906697:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d5000/0x5c74554e47ce4339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa804 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129101.906739:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4829d5000/0x5c74554e47ce4339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa804 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129101.906752:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5000, rc 0) 00000100:00100000:0.0:1789129101.906861:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+12:8140:x1876037604485376:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 328us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129101.906869:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:1.0:1789129101.914258:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129101.914518:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604485504 00000100:00100000:2.0:1789129101.914534:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604485504 00000100:00100000:2.0:1789129101.914649:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:2.0:1789129101.914663:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+12:8140:x1876037604485504:12345-192.168.201.39@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789129101.914709:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789129101.914751:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789129101.914756:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789129101.914759:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789129101.914762:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789129101.917731:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+12:8140:x1876037604485504:12345-192.168.201.39@tcp:256:mount.lustre.0 Request processed in 3049us (3468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129101.917750:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:3.0:1789129101.924422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129101.924746:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604485632 00000100:00100000:2.0:1789129101.924763:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604485632 00000100:00100000:2.0:1789129101.926298:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 221 00000100:00100000:2.0:1789129101.926329:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+12:8140:x1876037604485632:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789129101.926366:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129101.926416:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b489b87a00/0x5c74554e47ce4340 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa80b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129101.926483:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b489b87a00/0x5c74554e47ce4340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa80b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129101.926534:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b489b87a00/0x5c74554e47ce4340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa80b expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129101.926549:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87a00, rc 0) 00000100:00100000:2.0:1789129101.926724:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:8140:x1876037604485632:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 408us (2323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129101.926734:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 221 00000100:00100000:3.0:1789129101.933040:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129101.934173:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604485760 00000100:00100000:0.0:1789129101.934189:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604485760 00000100:00100000:0.0:1789129101.934272:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:0.0:1789129101.934287:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:8140:x1876037604485760:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789129101.935008:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:8140:x1876037604485760:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 719us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129101.935019:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:3.0:1789129101.938049:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129101.938453:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604485888 00000100:00100000:0.0:1789129101.938472:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604485888 00000100:00100000:0.0:1789129101.938559:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:0.0:1789129101.938573:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:8140:x1876037604485888:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789129101.939374:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:8140:x1876037604485888:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 797us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129101.939386:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:3.0:1789129101.943454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129101.943769:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604486016 00000100:00100000:2.0:1789129101.943792:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604486016 00000100:00100000:2.0:1789129101.943896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:2.0:1789129101.943922:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:8148:x1876037604486016:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789129101.944406:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:8148:x1876037604486016:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 496us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129101.944416:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:2.0:1789129101.952207:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129101.952403:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604486144 00000100:00100000:0.0:1789129101.952421:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604486144 00000100:00100000:0.0:1789129101.952516:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:0.0:1789129101.952531:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:8148:x1876037604486144:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789129101.953770:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:8148:x1876037604486144:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 1231us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129101.953788:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:1.0:1789129101.967771:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129101.967833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129101.968284:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604486272 00000100:00100000:3.0:1789129101.968300:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604486272 00000100:00100000:3.0:1789129101.968366:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604486400 00000100:00100000:3.0:1789129101.968370:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604486400 00000100:00100000:3.0:1789129101.968426:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:3.0:1789129101.968439:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604486400:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129101.968637:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789129101.968645:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3827492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2366:x1876037604486272:12345-192.168.201.39@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789129101.968683:0:5840:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 16cf7b7d-2f0c-40af-8c0b-6dce2288166b@192.168.201.39@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1789129101.968752:0:5840:0:(genops.c:1385:class_connect()) connect: client 16cf7b7d-2f0c-40af-8c0b-6dce2288166b, cookie 0x5c74554e47ce4347 00000004:00100000:0.0:1789129101.968817:0:5840:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1789129101.971474:0:5840:0:(import.c:65:import_set_state_nolock()) ffff90b4a7805000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789129101.978760:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604486400:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 10304us (10906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129101.978781:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:0.0:1789129101.980854:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3827492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2366:x1876037604486272:12345-192.168.201.39@tcp:38:mount.lustre.0 Request processed in 12192us (13091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129101.980871:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:1.0:1789129101.989123:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129101.989477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129101.995783:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604486528 00000100:00100000:0.0:1789129101.996202:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604486528 00000100:00100000:0.0:1789129101.996364:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604486656 00000100:00100000:0.0:1789129101.996370:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604486656 00000100:00100000:0.0:1789129101.996418:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1789129101.996431:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+7:0:x1876037604486528:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789129101.996512:0:6710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789129101.996762:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+7:0:x1876037604486528:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 333us (7654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129101.996772:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00080000:1.0:1789129101.997047:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129101.997092:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789129101.997106:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:8140:x1876037604486656:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789129101.997126:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789129101.997162:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:8140:x1876037604486656:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 62us (7686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129101.997169:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:2.0:1789129102.002785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129102.002945:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604486784 00000100:00100000:1.0:1789129102.002968:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604486784 00000100:00100000:1.0:1789129102.003042:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1789129102.003055:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:8140:x1876037604486784:12345-192.168.201.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789129102.003199:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:8140:x1876037604486784:12345-192.168.201.39@tcp:40:mount.lustre.0 Request processed in 145us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129102.003208:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1789129102.006156:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129102.006242:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129102.006285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129102.006412:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604486912 00000100:00100000:0.0:1789129102.006427:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604486912 00000100:00100000:0.0:1789129102.006485:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604487040 00000100:00100000:0.0:1789129102.006499:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604487040 00000100:00100000:0.0:1789129102.006519:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1789129102.006531:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037604486912:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789129102.006578:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 16cf7b7d-2f0c-40af-8c0b-6dce2288166b@192.168.201.39@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1789129102.006668:0:6686:0:(genops.c:1385:class_connect()) connect: client 16cf7b7d-2f0c-40af-8c0b-6dce2288166b, cookie 0x5c74554e47ce434e 00002000:00100000:0.0:1789129102.006687:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 16cf7b7d-2f0c-40af-8c0b-6dce2288166b/ffff90b4a7a48800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789129102.006720:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789129102.007102:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789129102.007152:0:6686:0:(import.c:65:import_set_state_nolock()) ffff90b4a7a48000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789129102.007259:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2366:x1876037604486912:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 727us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129102.007269:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1789129102.007298:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1789129102.007304:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037604487040:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789129102.007326:0:6686:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 16cf7b7d-2f0c-40af-8c0b-6dce2288166b@192.168.201.39@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1789129102.007350:0:6686:0:(genops.c:1385:class_connect()) connect: client 16cf7b7d-2f0c-40af-8c0b-6dce2288166b, cookie 0x5c74554e47ce4355 00002000:00100000:0.0:1789129102.007357:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 16cf7b7d-2f0c-40af-8c0b-6dce2288166b/ffff90b4a7a4d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789129102.007377:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789129102.007539:0:6686:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789129102.007558:0:6686:0:(import.c:65:import_set_state_nolock()) ffff90b4c094c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789129102.007586:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2366:x1876037604487040:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 281us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129102.007594:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1789129102.009542:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604487168 00000100:00100000:3.0:1789129102.009563:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604487168 00000100:00100000:3.0:1789129102.009753:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1789129102.009766:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:8140:x1876037604487168:12345-192.168.201.39@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789129102.010300:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789129102.010766:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:8140:x1876037604487168:12345-192.168.201.39@tcp:33:mount.lustre.0 Request processed in 999us (4623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129102.010777:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00010000:00010000:2.0:1789129102.535687:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129103.558921:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129103.622302:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626541056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129103.622428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129103.622719:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626541056 00000100:00100000:2.0:1789129103.622739:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626541056 00000100:00100000:2.0:1789129103.622821:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789129103.622834:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626541056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129103.622865:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129103.622940:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626541056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (502us total) trans 0 rc 0/0 00000100:00080000:0.0:1789129103.622944:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129103.622949:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789129103.623107:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b485da3c00 x1876037626541056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129103.623134:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626541056:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789129103.824596:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 16cf7b7d-2f0c-40af-8c0b-6dce2288166b 00010000:00010000:0.0:1789129104.582802:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789129104.691650:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 16cf7b7d-2f0c-40af-8c0b-6dce2288166b 00000100:00100000:1.0:1789129105.163807:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129105.163834:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626541184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129105.164036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129105.164167:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626541184 00000100:00100000:1.0:1789129105.164178:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626541184 00000100:00100000:1.0:1789129105.164249:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789129105.164259:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626541184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129105.164302:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129105.164353:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626541184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129105.164361:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789129105.164489:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129105.164562:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626541312:0@lo:400:kworker.0 00000100:00100000:0.0:1789129105.164599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129105.164655:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626541312 00000100:00100000:0.0:1789129105.164660:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626541312 00000100:00100000:0.0:1789129105.164689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789129105.164696:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626541312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129105.164731:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626541312:12345-0@lo:400:kworker.0 Request processed in 35us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129105.164737:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00080000:1.0:1789129105.165566:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4c0e3cb40 x1876037626541184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129105.165589:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626541184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129105.167185:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626541312:0@lo:400:kworker.0 00000100:00100000:2.0:1789129105.167305:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129105.167349:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129105.167362:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626541568:0@lo:400:kworker.0 00000100:00100000:0.0:1789129105.167456:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129105.167515:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626541568 00000100:00100000:0.0:1789129105.167521:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626541568 00000100:00100000:0.0:1789129105.167590:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789129105.167622:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626541568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129105.167683:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626541568:12345-0@lo:400:kworker.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129105.167691:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789129105.167716:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129105.167743:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626541568:0@lo:400:kworker.0 00000100:00100000:0.0:1789129105.167778:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626541696:0@lo:400:kworker.0 00000100:00100000:0.0:1789129105.167815:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129105.167861:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626541696 00000100:00100000:0.0:1789129105.167865:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626541696 00000100:00100000:0.0:1789129105.171432:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789129105.171469:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626541696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129105.171626:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626541696:12345-0@lo:400:kworker.0 Request processed in 175us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129105.171634:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789129105.171693:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789129105.177853:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a780da40 x1876037626541696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129105.177872:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626541696:0@lo:400:kworker.0 00000100:00100000:2.0:1789129105.183259:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626541824:0@lo:400:kworker.0 00000100:00100000:2.0:1789129105.183343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129105.184425:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626541440:0@lo:400:kworker.0 00000100:00100000:2.0:1789129105.184468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129105.204997:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626541824 00000100:00100000:0.0:1789129105.205016:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626541824 00000100:00100000:0.0:1789129105.208591:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626541440 00000100:00100000:0.0:1789129105.208631:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626541440 00000100:00100000:0.0:1789129105.208676:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789129105.208687:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626541824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129105.208820:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626541824:12345-0@lo:400:kworker.0 Request processed in 134us (25476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129105.208828:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789129105.208858:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789129105.208865:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626541440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129105.209032:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626541440:12345-0@lo:400:kworker.0 Request processed in 167us (24563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129105.209039:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789129105.209226:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0e3cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626541824:0@lo:400:kworker.0 00000100:00100000:0.0:1789129105.209267:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626541440:0@lo:400:kworker.0 00000100:00080000:2.0:1789129105.221964:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789129105.624423:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789129105.750046:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 16cf7b7d-2f0c-40af-8c0b-6dce2288166b 00010000:00010000:3.0:1789129106.631218:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129107.487769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129107.487825:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129107.487876:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129107.487899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129107.487925:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129107.488069:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604487680 00000100:00100000:3.0:1789129107.488083:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604487680 00000100:00100000:3.0:1789129107.488153:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604487808 00000100:00100000:3.0:1789129107.488157:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604487808 00000100:00100000:3.0:1789129107.488177:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1789129107.488187:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604487680:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129107.488270:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604487680:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 84us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129107.488278:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1789129107.488296:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1789129107.488303:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604487808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129107.488327:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604487808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129107.488333:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00080000:2.0:1789129107.488425:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789129107.488431:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129107.489978:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604487424 00000100:00100000:0.0:1789129107.489989:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604487424 00000100:00100000:0.0:1789129107.490053:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604487552 00000100:00100000:0.0:1789129107.490057:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604487552 00000100:00100000:0.0:1789129107.490089:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789129107.490097:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604487424:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129107.490153:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604487424:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 57us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129107.490162:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789129107.490179:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1789129107.490185:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604487552:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129107.490210:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604487552:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129107.490216:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1789129107.490236:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604487296 00000100:00100000:0.0:1789129107.490240:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604487296 00000100:00100000:0.0:1789129107.490264:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:0.0:1789129107.490271:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604487296:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129107.490294:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604487296:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (2419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129107.490301:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00080000:2.0:1789129107.490626:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789129107.672492:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129108.686422:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129108.747306:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789129108.747329:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485da1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626541952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129108.747401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129108.747469:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626541952 00000100:00100000:2.0:1789129108.747476:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626541952 00000100:00100000:2.0:1789129108.747532:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789129108.747542:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626541952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129108.747581:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129108.747655:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626541952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129108.747665:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789129108.747690:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789129108.747728:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b485da1a40 x1876037626541952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129108.747747:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485da1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626541952:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789129109.602145:0:10307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789129109.704423:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129110.278124:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626542080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129110.278190:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129110.278262:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626542592:0@lo:400:kworker.0 00000100:00100000:2.0:1789129110.278287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129110.278311:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789129110.278316:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626542208:0@lo:400:kworker.0 00000100:00100000:2.0:1789129110.278339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129110.278357:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626542720:0@lo:400:kworker.0 00000100:00100000:2.0:1789129110.278376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129110.278399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626542208 00000100:00100000:2.0:1789129110.278405:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626542208 00000100:00100000:2.0:1789129110.278442:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789129110.278449:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626542208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129110.278503:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626542208:12345-0@lo:400:kworker.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129110.278510:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789129110.278541:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626542720 00000100:00100000:2.0:1789129110.278544:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626542720 00000100:00100000:2.0:1789129110.278573:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789129110.278578:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626542720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129110.278633:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626542720:12345-0@lo:400:kworker.0 Request processed in 54us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129110.278640:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1789129110.278657:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129110.278679:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626542208:0@lo:400:kworker.0 00000100:00100000:2.0:1789129110.278691:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626542720:0@lo:400:kworker.0 00000100:00100000:3.0:1789129110.278854:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626542464:0@lo:400:kworker.0 00000100:00100000:3.0:1789129110.278882:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129110.278916:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789129110.278921:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626542336:0@lo:400:kworker.0 00000100:00100000:3.0:1789129110.278940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129110.278953:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626542848:0@lo:400:kworker.0 00000100:00100000:3.0:1789129110.278968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129110.278987:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626542592 00000100:00100000:3.0:1789129110.278990:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626542592 00000100:00100000:3.0:1789129110.279020:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626542848 00000100:00100000:3.0:1789129110.279023:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626542848 00000100:00100000:3.0:1789129110.279047:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789129110.279053:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626542592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129110.279083:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626542592:12345-0@lo:400:kworker.0 Request processed in 30us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129110.279089:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789129110.279100:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789129110.279105:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626542848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129110.279130:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626542848:12345-0@lo:400:kworker.0 Request processed in 25us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129110.279135:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789129110.279150:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626542464 00000100:00100000:3.0:1789129110.279153:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626542464 00000100:00100000:3.0:1789129110.279171:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626542336 00000100:00100000:3.0:1789129110.279173:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626542336 00000100:00100000:3.0:1789129110.279183:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789129110.279188:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626542464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129110.279213:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626542464:12345-0@lo:400:kworker.0 Request processed in 24us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129110.279218:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789129110.279234:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789129110.279239:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626542336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129110.279262:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626542336:12345-0@lo:400:kworker.0 Request processed in 23us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129110.279267:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789129110.279280:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789129110.279283:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789129110.279285:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129110.279300:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626542336:0@lo:400:kworker.0 00010000:00080000:3.0:1789129110.279310:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6c780 x1876037626542848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129110.279319:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626542848:0@lo:400:kworker.0 00000100:00100000:3.0:1789129110.279327:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626542464:0@lo:400:kworker.0 00000100:00100000:0.0:1789129110.279546:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626542080 00000100:00100000:0.0:1789129110.279551:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626542080 00000100:00100000:0.0:1789129110.279583:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789129110.279589:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626542080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789129110.279649:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129110.279685:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626542080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129110.279692:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789129110.280053:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4c0e3e940 x1876037626542080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129110.280080:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0e3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626542080:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789129110.280092:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6da40 x1876037626542592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129110.280100:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626542592:0@lo:400:kworker.0 00010000:00010000:0.0:1789129110.726117:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129111.750180:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129112.603347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129112.603415:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129112.603453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129112.603562:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604487936 00000100:00100000:0.0:1789129112.603575:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604487936 00000100:00100000:2.0:1789129112.603712:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604488448 00000100:00100000:2.0:1789129112.603718:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604488448 00000100:00100000:2.0:1789129112.603816:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1789129112.603817:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 229 00000100:00100000:2.0:1789129112.603834:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604488448:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129112.603835:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604487936:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:1.0:1789129112.603939:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129112.603949:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604488192 00000100:00100000:3.0:1789129112.603955:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604488192 00000100:00100000:3.0:1789129112.604012:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:3.0:1789129112.604020:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604488192:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:1.0:1789129112.604073:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129112.607332:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604488448:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 3485us (3858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129112.607350:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:2.0:1789129112.611993:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604487936:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 8145us (8642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129112.612021:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 229 00000100:00100000:2.0:1789129112.615348:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604488192:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 11308us (11911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129112.615370:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:1.0:1789129112.644253:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129112.646037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129112.646115:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604488320 00000100:00100000:1.0:1789129112.646129:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604488320 00000100:00100000:1.0:1789129112.646219:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789129112.646235:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604488320:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129112.646338:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604488320:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 107us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129112.646346:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00080000:1.0:1789129112.646375:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129112.651640:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604488064 00000100:00100000:2.0:1789129112.651671:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604488064 00000100:00100000:2.0:1789129112.651823:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1789129112.651838:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604488064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:1.0:1789129112.652233:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129112.652874:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604488064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 1032us (8629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129112.652911:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00010000:00010000:3.0:1789129112.779469:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129113.798421:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129113.867683:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0e3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626542976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129113.867822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129113.873369:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626542976 00000100:00100000:0.0:1789129113.873406:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626542976 00000100:00100000:0.0:1789129113.873545:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789129113.873560:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626542976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129113.873648:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129113.873805:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626542976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 248us (5982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129113.873815:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789129113.873952:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129113.875681:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4c0e3d680 x1876037626542976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129113.875718:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0e3d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626542976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789129114.830160:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129115.400146:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626543104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129115.400327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129115.404715:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626543104 00000100:00100000:1.0:1789129115.404754:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626543104 00000100:00100000:1.0:1789129115.405712:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789129115.405741:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626543104:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789129115.405947:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129115.406118:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626543232:0@lo:400:kworker.0 00000100:00100000:0.0:1789129115.406249:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129115.406314:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626543744:0@lo:400:kworker.0 00000100:00100000:0.0:1789129115.406363:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129115.406400:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129115.406407:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626543616:0@lo:400:kworker.0 00000100:00100000:0.0:1789129115.406440:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129115.406506:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626543360:0@lo:400:kworker.0 00000100:00100000:0.0:1789129115.406563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129115.406589:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129115.406596:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626543488:0@lo:400:kworker.0 00000100:00100000:0.0:1789129115.406653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129115.406699:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626543232 00000100:00100000:0.0:1789129115.406709:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626543232 00002000:00000024:1.0:1789129115.407016:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129115.407106:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626543104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1371us (6779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129115.407131:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789129115.407536:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789129115.407554:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626543232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129115.407657:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626543232:12345-0@lo:400:kworker.0 Request processed in 110us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129115.407667:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789129115.407728:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626543744 00000100:00100000:0.0:1789129115.407737:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626543744 00000100:00100000:2.0:1789129115.407932:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626543232:0@lo:400:kworker.0 00000100:00080000:1.0:1789129115.408977:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129115.409131:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626543360 00000100:00100000:2.0:1789129115.409143:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626543360 00000100:00100000:2.0:1789129115.409228:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626543488 00000100:00100000:2.0:1789129115.409233:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626543488 00000100:00100000:2.0:1789129115.409263:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789129115.409273:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626543360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129115.409403:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626543360:12345-0@lo:400:kworker.0 Request processed in 131us (2840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129115.409412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789129115.409433:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789129115.409440:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626543488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129115.409471:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626543488:12345-0@lo:400:kworker.0 Request processed in 32us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129115.409478:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789129115.409512:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626543616 00000100:00100000:2.0:1789129115.409517:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626543616 00000100:00100000:2.0:1789129115.409555:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789129115.409562:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626543616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129115.409650:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626543616:12345-0@lo:400:kworker.0 Request processed in 88us (3209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129115.409657:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789129115.409687:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789129115.409698:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626543744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129115.409752:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626543744:12345-0@lo:400:kworker.0 Request processed in 56us (3387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129115.409759:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1789129115.409850:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902fa1c0 x1876037626543104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129115.409881:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626543104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129115.410743:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626543488:0@lo:400:kworker.0 00000100:00100000:3.0:1789129115.411199:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626543360:0@lo:400:kworker.0 00000100:00080000:3.0:1789129115.411289:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789129115.411298:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789129115.411374:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6ed00 x1876037626543616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129115.411402:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626543616:0@lo:400:kworker.0 00000100:00100000:3.0:1789129115.411424:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626543744:0@lo:400:kworker.0 00010000:00010000:3.0:1789129115.847377:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129116.872881:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129117.727335:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129117.727390:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129117.727422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129117.727457:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129117.727537:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604488832 00000100:00100000:3.0:1789129117.727549:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604488832 00000100:00100000:3.0:1789129117.727709:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604488704 00000100:00100000:3.0:1789129117.727714:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604488704 00000100:00100000:3.0:1789129117.727746:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1789129117.727757:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490230780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604488832:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129117.728033:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604488576 00000100:00100000:2.0:1789129117.728038:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604488576 00000100:00100000:2.0:1789129117.728070:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:2.0:1789129117.728078:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604488576:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129117.728137:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490230780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604488832:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 381us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129117.728145:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1789129117.728163:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:3.0:1789129117.728169:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490231680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604488704:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129117.743768:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604488576:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 15665us (16423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129117.743792:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:3.0:1789129117.747940:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490231680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604488704:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 19752us (20497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129117.747961:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:3.0:1789129117.748034:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604488960 00000100:00100000:3.0:1789129117.748046:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604488960 00000100:00100000:3.0:1789129117.748103:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1789129117.748113:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604488960:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129117.748182:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604488960:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 70us (20724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129117.748190:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00080000:3.0:1789129117.748211:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789129117.748217:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129117.748294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129117.748460:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604489088 00000100:00100000:3.0:1789129117.748465:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604489088 00000100:00100000:3.0:1789129117.748495:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:3.0:1789129117.748502:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604489088:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129117.748536:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5532c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604489088:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129117.748543:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00080000:3.0:1789129117.748901:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789129117.902265:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129118.918539:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129118.983420:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789129118.983447:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626543872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129118.983528:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129118.983691:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626543872 00000100:00100000:2.0:1789129118.983701:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626543872 00000100:00100000:2.0:1789129118.983760:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789129118.983770:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626543872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129118.983806:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129118.983856:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626543872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129118.983865:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789129118.983910:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902f83c0 x1876037626543872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129118.983929:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626543872:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789129118.985779:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789129119.949492:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129120.517887:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626544128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129120.517970:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129120.518093:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490233840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626544768:0@lo:400:kworker.0 00000100:00100000:2.0:1789129120.518120:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129120.518138:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789129120.518143:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490233c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626544256:0@lo:400:kworker.0 00000100:00100000:2.0:1789129120.518206:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129120.518226:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626544640:0@lo:400:kworker.0 00000100:00100000:2.0:1789129120.518249:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129120.518281:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626544256 00000100:00100000:2.0:1789129120.518288:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626544256 00000100:00100000:3.0:1789129120.518294:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626544128 00000100:00100000:3.0:1789129120.518298:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626544128 00000100:00100000:2.0:1789129120.518327:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626544640 00000100:00100000:2.0:1789129120.518331:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626544640 00000100:00100000:3.0:1789129120.518334:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789129120.518343:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626544128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129120.518361:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789129120.518367:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626544256:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789129120.518392:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129120.518458:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490230b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626544384:0@lo:400:kworker.0 00000100:00100000:2.0:1789129120.518497:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626544256:12345-0@lo:400:kworker.0 Request processed in 128us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129120.518504:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789129120.518532:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789129120.518540:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626544640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129120.518598:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626544000:0@lo:400:kworker.0 00000100:00100000:0.0:1789129120.526247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129120.526400:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626544384 00000100:00100000:2.0:1789129120.529636:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626544640:12345-0@lo:400:kworker.0 Request processed in 11078us (11365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129120.529652:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789129120.529756:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490233c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626544256:0@lo:400:kworker.0 00000100:00100000:2.0:1789129120.529770:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626544640:0@lo:400:kworker.0 00010000:00080000:2.0:1789129120.529786:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902fbc00 x1876037626544128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129120.529808:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626544128:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789129120.529889:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789129120.529897:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789129120.529921:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626544768 00000100:00100000:2.0:1789129120.529944:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626544768 00000100:00100000:2.0:1789129120.530014:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789129120.530024:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626544768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129120.530092:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626544768:12345-0@lo:400:kworker.0 Request processed in 71us (11971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129120.530100:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789129120.530128:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b490233840 x1876037626544768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129120.530138:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490233840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626544768:0@lo:400:kworker.0 00000100:00100000:0.0:1789129120.530404:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626544384 00000100:00100000:0.0:1789129120.531657:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789129120.531667:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626544384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129120.531755:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626544384:12345-0@lo:400:kworker.0 Request processed in 89us (5517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129120.531762:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789129120.531814:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490230b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626544384:0@lo:400:kworker.0 00000100:00080000:2.0:1789129120.535670:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129120.536180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129120.536276:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626544512:0@lo:400:kworker.0 00000100:00100000:1.0:1789129120.536339:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129120.536593:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626544512 00000100:00100000:2.0:1789129120.536644:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626544512 00000100:00100000:2.0:1789129120.536711:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789129120.536721:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626544512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129120.536795:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626544512:12345-0@lo:400:kworker.0 Request processed in 75us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129120.536803:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789129120.537399:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626544128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 19053us (19426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129120.537410:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789129120.538518:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626544000 00000100:00100000:0.0:1789129120.538529:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626544000 00000100:00100000:0.0:1789129120.538584:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789129120.538593:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626544000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129120.538692:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626544000:12345-0@lo:400:kworker.0 Request processed in 100us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129120.538699:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00080000:1.0:1789129120.539325:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129120.539393:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626544000:0@lo:400:kworker.0 00010000:00080000:1.0:1789129120.539425:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902330c0 x1876037626544512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129120.539439:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626544512:0@lo:400:kworker.0 00010000:00010000:3.0:1789129120.966423:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129121.991904:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129122.846011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129122.846068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129122.846118:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129122.846155:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129122.846186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129122.846223:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604489216 00000100:00100000:3.0:1789129122.846233:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604489216 00000100:00100000:3.0:1789129122.846292:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:3.0:1789129122.846302:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604489216:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129122.846382:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604489216:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 80us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129122.846389:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:3.0:1789129122.846425:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604489472 00000100:00100000:3.0:1789129122.846428:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604489472 00000100:00100000:3.0:1789129122.846472:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604489344 00000100:00100000:3.0:1789129122.846476:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604489344 00000100:00100000:3.0:1789129122.846498:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:3.0:1789129122.846506:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2370:x1876037604489472:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129122.846537:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2370:x1876037604489472:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129122.846544:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:3.0:1789129122.846555:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789129122.846561:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490232940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604489344:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129122.846580:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490232940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604489344:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 19us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129122.846600:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:1.0:1789129122.846913:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604489600 00000100:00100000:1.0:1789129122.846919:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604489600 00000100:00100000:1.0:1789129122.846951:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604489728 00000100:00100000:1.0:1789129122.846953:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604489728 00000100:00100000:1.0:1789129122.846971:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789129122.846978:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2366:x1876037604489600:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:1.0:1789129122.846999:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce434e 00000100:00080000:1.0:1789129122.847008:0:6688:0:(import.c:65:import_set_state_nolock()) ffff90b4a7a48000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789129122.847052:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789129122.847459:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+2:2366:x1876037604489600:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 479us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129122.847483:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789129122.847502:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:1.0:1789129122.847510:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490232580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2366:x1876037604489728:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:1.0:1789129122.847523:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4355 00000100:00080000:1.0:1789129122.847529:0:6688:0:(import.c:65:import_set_state_nolock()) ffff90b4c094c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789129122.847549:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789129122.847829:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490232580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+2:2366:x1876037604489728:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 319us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129122.847836:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00080000:1.0:1789129122.847854:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789129122.847858:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789129122.847860:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789129122.847869:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129122.848406:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129123.013929:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129124.037756:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129124.102700:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626544896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789129124.102777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129124.103110:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626544896 00000100:00100000:0.0:1789129124.103121:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626544896 00000100:00100000:0.0:1789129124.103182:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789129124.103192:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626544896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129124.103233:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129124.103291:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626544896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129124.103300:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789129124.103323:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789129124.103360:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b490233480 x1876037626544896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129124.103385:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626544896:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1789129124.193499:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 16cf7b7d-2f0c-40af-8c0b-6dce2288166b 00000020:00000080:1.0:1789129124.193520:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b4a7a48800/16cf7b7d-2f0c-40af-8c0b-6dce2288166b 00000020:00000080:2.0:1789129124.193698:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7a48800/16cf7b7d-2f0c-40af-8c0b-6dce2288166b for lustre-OST0000 00000020:00000080:2.0:1789129124.193739:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4a7a48000 for lustre-OST0000 00010000:00010000:3.0:1789129125.061873:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129125.637926:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129125.637960:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626545024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129125.638085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129125.638439:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626545024 00000100:00100000:1.0:1789129125.638450:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626545024 00000100:00100000:1.0:1789129125.638549:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789129125.638563:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626545024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129125.638661:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129125.638725:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626545024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129125.638733:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789129125.638787:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902f83c0 x1876037626545024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129125.638839:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626545024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129125.639586:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626545536:0@lo:400:kworker.0 00000100:00100000:2.0:1789129125.639679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129125.639721:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789129125.639727:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626545408:0@lo:400:kworker.0 00000100:00100000:2.0:1789129125.639755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129125.639785:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626545408 00000100:00100000:2.0:1789129125.639790:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626545408 00000100:00100000:2.0:1789129125.639851:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789129125.639860:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626545408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129125.639910:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626545408:12345-0@lo:400:kworker.0 Request processed in 52us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129125.639918:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789129125.639955:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626545408:0@lo:400:kworker.0 00000100:00100000:3.0:1789129125.640137:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626545280:0@lo:400:kworker.0 00000100:00100000:3.0:1789129125.640182:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129125.640209:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789129125.640225:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626545152:0@lo:400:kworker.0 00000100:00100000:3.0:1789129125.640254:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129125.640277:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626545664:0@lo:400:kworker.0 00000100:00100000:3.0:1789129125.640298:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129125.640531:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626545280 00000100:00100000:2.0:1789129125.640546:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626545280 00000100:00100000:2.0:1789129125.640580:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626545664 00000100:00100000:2.0:1789129125.640583:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626545664 00000100:00100000:2.0:1789129125.640627:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789129125.640645:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490231a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626545280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129125.640691:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490231a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626545280:12345-0@lo:400:kworker.0 Request processed in 58us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129125.640699:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789129125.640711:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789129125.640717:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490231e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626545664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129125.640747:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490231e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626545664:12345-0@lo:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129125.640752:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789129125.640783:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626545664:0@lo:400:kworker.0 00000100:00100000:2.0:1789129125.640792:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626545280:0@lo:400:kworker.0 00000100:00080000:0.0:1789129125.640869:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789129125.640874:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129125.640885:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626545152 00000100:00100000:0.0:1789129125.640889:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626545152 00000100:00100000:0.0:1789129125.640922:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789129125.640929:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626545152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129125.640966:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626545152:12345-0@lo:400:kworker.0 Request processed in 38us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129125.640973:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789129125.641004:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626545152:0@lo:400:kworker.0 00000100:00100000:1.0:1789129125.643007:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626545536 00000100:00100000:1.0:1789129125.643032:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626545536 00000100:00100000:1.0:1789129125.643100:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789129125.643110:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626545536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129125.643243:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626545536:12345-0@lo:400:kworker.0 Request processed in 135us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129125.643251:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789129125.643413:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6e940 x1876037626545536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129125.643430:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626545536:0@lo:400:kworker.0 00010000:00010000:3.0:1789129126.086045:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789129126.243339:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 16cf7b7d-2f0c-40af-8c0b-6dce2288166b 00000020:00000080:3.0:1789129126.243353:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b4a7a4d800/16cf7b7d-2f0c-40af-8c0b-6dce2288166b 00000020:00000080:1.0:1789129126.243449:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7a4d800/16cf7b7d-2f0c-40af-8c0b-6dce2288166b for lustre-OST0001 00000020:00000080:1.0:1789129126.243513:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c094c800 for lustre-OST0001 00010000:00010000:2.0:1789129127.109786:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129127.967550:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129127.967680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129127.967706:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129127.967736:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604490112 00000100:00100000:3.0:1789129127.967746:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604490112 00000100:00100000:3.0:1789129127.967836:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604489984 00000100:00100000:3.0:1789129127.967840:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604489984 00000100:00100000:3.0:1789129127.967863:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1789129127.967874:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490232d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604490112:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129127.967954:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490232d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604490112:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129127.967980:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1789129127.967998:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:3.0:1789129127.968004:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604489984:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129127.968027:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604489984:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 22us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129127.968032:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:0.0:1789129127.976768:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604489856 00000100:00100000:0.0:1789129127.976784:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604489856 00000100:00100000:0.0:1789129127.979683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:0.0:1789129127.979706:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2368:x1876037604489856:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129127.979839:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2368:x1876037604489856:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 140us (12301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129127.979860:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00080000:0.0:1789129127.990224:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789129128.146951:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129129.157890:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129129.225401:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129129.225438:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626545792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129129.225530:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129129.225595:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626545792 00000100:00100000:1.0:1789129129.225624:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626545792 00000100:00100000:1.0:1789129129.225681:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789129129.225691:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626545792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789129129.225737:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129129.225792:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626545792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129129.225800:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789129129.225827:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129129.225862:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6ed00 x1876037626545792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129129.225884:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626545792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789129130.186071:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129130.757976:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626545920:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.758097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129130.758182:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626546432:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.758216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129130.758248:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789129130.758254:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626546048:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.758276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129130.758294:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626546560:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.758320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129130.758346:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626546176:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.758370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129130.758390:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129130.758410:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626546304:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.758432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129130.758473:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626545920 00000100:00100000:1.0:1789129130.758482:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626545920 00000100:00100000:1.0:1789129130.758557:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789129130.758569:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626545920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.758669:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626545920:12345-0@lo:400:kworker.0 Request processed in 102us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129130.758676:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789129130.758720:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626546432 00000100:00100000:1.0:1789129130.758725:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626546432 00000100:00100000:1.0:1789129130.758767:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626546048 00000100:00100000:1.0:1789129130.758770:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626546048 00000100:00100000:1.0:1789129130.758813:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626546176 00000100:00100000:1.0:1789129130.758817:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626546176 00000100:00100000:1.0:1789129130.758833:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789129130.758841:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626546432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.758882:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626546432:12345-0@lo:400:kworker.0 Request processed in 42us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129130.758888:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789129130.758900:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789129130.758906:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626546048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.758933:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626546048:12345-0@lo:400:kworker.0 Request processed in 28us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129130.758940:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789129130.758951:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789129130.758958:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626546176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.758990:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626546176:12345-0@lo:400:kworker.0 Request processed in 33us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129130.758997:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789129130.759023:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626546560 00000100:00100000:1.0:1789129130.759026:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626546560 00000100:00100000:1.0:1789129130.759054:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626546304 00000100:00100000:1.0:1789129130.759057:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626546304 00000100:00100000:1.0:1789129130.759071:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789129130.759078:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626546560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.759129:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626546560:12345-0@lo:400:kworker.0 Request processed in 51us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129130.759136:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789129130.759149:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789129130.759164:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626546304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.759197:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626546304:12345-0@lo:400:kworker.0 Request processed in 35us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129130.759204:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789129130.759238:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789129130.759244:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789129130.759307:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6cf00 x1876037626546304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129130.759324:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626546304:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.759338:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626546176:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.759372:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626546048:0@lo:400:kworker.0 00010000:00080000:1.0:1789129130.759384:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6e1c0 x1876037626546560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129130.759392:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626546560:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.759401:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626545920:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.759413:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626546432:0@lo:400:kworker.0 00000100:00100000:1.0:1789129130.760268:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626546688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129130.760330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129130.760570:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626546688 00000100:00100000:2.0:1789129130.760577:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626546688 00000100:00100000:2.0:1789129130.760660:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789129130.760683:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626546688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129130.760730:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129130.760781:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626546688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129130.760789:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789129130.761209:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6e940 x1876037626546688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129130.761232:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626546688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789129131.211696:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129132.229901:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129133.098537:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129133.098976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129133.099018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129133.099523:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604490496 00000100:00100000:0.0:1789129133.099535:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604490496 00000100:00100000:0.0:1789129133.099637:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604490368 00000100:00100000:0.0:1789129133.099640:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604490368 00000100:00100000:0.0:1789129133.099664:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:0.0:1789129133.099674:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604490496:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129133.099756:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604490496:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 83us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129133.099764:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:0.0:1789129133.099780:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:0.0:1789129133.099787:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604490368:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129133.099810:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604490368:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129133.099816:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00080000:2.0:1789129133.100156:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129133.108204:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604490240 00000100:00100000:1.0:1789129133.108226:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604490240 00000100:00100000:1.0:1789129133.108298:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:1.0:1789129133.108308:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604490240:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129133.108398:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604490240:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 90us (9871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129133.108416:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 237 00000001:02000400:2.0:1789129133.164966:0:11011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789129133.260185:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129134.277843:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129134.342573:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626546816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129134.342716:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129134.343295:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626546816 00000100:00100000:2.0:1789129134.343304:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626546816 00000100:00100000:2.0:1789129134.343397:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789129134.343407:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626546816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129134.343444:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129134.343500:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626546816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129134.343509:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789129134.345897:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129134.345960:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6cb40 x1876037626546816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129134.345993:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626546816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789129135.302916:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129135.884197:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626547072:0@lo:400:kworker.0 00000100:00100000:3.0:1789129135.884300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129135.884393:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490233c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626547584:0@lo:400:kworker.0 00000100:00100000:3.0:1789129135.884424:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129135.884453:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789129135.884459:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626546944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129135.884486:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129135.884516:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626547456:0@lo:400:kworker.0 00000100:00100000:3.0:1789129135.884541:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129135.884566:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490233840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626547328:0@lo:400:kworker.0 00000100:00100000:3.0:1789129135.884618:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129135.884625:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490230b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626547200:0@lo:400:kworker.0 00000100:00100000:2.0:1789129135.884654:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129135.884659:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626547072 00000100:00100000:3.0:1789129135.884666:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626547072 00000100:00100000:2.0:1789129135.884673:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490230f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626547712:0@lo:400:kworker.0 00000100:00100000:2.0:1789129135.884691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129135.884718:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626547584 00000100:00100000:3.0:1789129135.884721:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789129135.884722:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626547584 00000100:00100000:3.0:1789129135.884730:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626547072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129135.884764:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626547328 00000100:00100000:2.0:1789129135.884767:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626547328 00000100:00100000:2.0:1789129135.884781:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626547200 00000100:00100000:2.0:1789129135.884791:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626547200 00000100:00100000:3.0:1789129135.884799:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626547072:12345-0@lo:400:kworker.0 Request processed in 70us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129135.884807:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789129135.884807:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789129135.884812:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626547584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129135.884844:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789129135.884846:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626547584:12345-0@lo:400:kworker.0 Request processed in 33us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129135.884852:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626547328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129135.884852:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789129135.884864:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789129135.884870:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626547200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129135.884882:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626547328:12345-0@lo:400:kworker.0 Request processed in 32us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129135.884889:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789129135.884895:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626547200:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129135.884901:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789129135.884907:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626546944 00000100:00100000:3.0:1789129135.884911:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626546944 00000100:00100000:2.0:1789129135.884933:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626547456 00000100:00100000:2.0:1789129135.884937:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626547456 00000100:00100000:3.0:1789129135.884939:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789129135.884945:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626546944:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129135.884961:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626547712 00000100:00100000:2.0:1789129135.884964:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626547712 00000100:00100000:2.0:1789129135.884974:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789129135.884980:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626547456:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789129135.884981:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129135.885009:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626546944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129135.885009:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626547456:12345-0@lo:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129135.885016:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789129135.885016:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789129135.885027:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789129135.885032:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626547712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129135.885056:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490233840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626547328:0@lo:400:kworker.0 00000100:00100000:2.0:1789129135.885056:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626547712:12345-0@lo:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129135.885062:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789129135.885076:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789129135.885081:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789129135.885085:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bab6e1c0 x1876037626546944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129135.885100:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626546944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129135.885107:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490230b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626547200:0@lo:400:kworker.0 00010000:00080000:3.0:1789129135.885108:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b490230000 x1876037626547456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789129135.885115:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b490230f00 x1876037626547712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129151 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129135.885117:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490230000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626547456:0@lo:400:kworker.0 00000100:00100000:2.0:1789129135.885123:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490230f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626547712:0@lo:400:kworker.0 00000100:00100000:3.0:1789129135.885131:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626547072:0@lo:400:kworker.0 00000100:00100000:3.0:1789129135.885140:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490233c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626547584:0@lo:400:kworker.0 00010000:00010000:2.0:1789129136.325862:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129137.350151:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129138.204840:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129138.204888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129138.204918:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129138.204946:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604490880 00000100:00100000:2.0:1789129138.204955:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604490880 00000100:00100000:2.0:1789129138.205013:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604490752 00000100:00100000:2.0:1789129138.205017:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604490752 00000100:00100000:2.0:1789129138.205042:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:2.0:1789129138.205052:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604490880:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129138.205130:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604490880:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129138.205137:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:2.0:1789129138.205156:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1789129138.205162:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604490752:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129138.205187:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604490752:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129138.205193:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00080000:2.0:1789129138.205213:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129138.205368:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604490624 00000100:00100000:0.0:1789129138.205372:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604490624 00000100:00100000:0.0:1789129138.205410:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:0.0:1789129138.205418:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2368:x1876037604490624:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129138.205452:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2368:x1876037604490624:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 35us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129138.205458:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 239 00010000:00010000:2.0:1789129138.374939:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789129138.590596:0:11160:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd77fc7230 20000000:00000080:2.0:1789129138.590863:0:11160:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b382825400 uarg=0000000000000000 20000000:01000000:2.0:1789129138.590912:0:11160:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789129138.590918:0:11160:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789129138.590924:0:11160:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789129138.592863:0:11161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789129138.593087:0:11160:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789129138.610055:0:11160:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789129138.610086:0:11160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610105:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b489b86c00/0x5c74554e47ce4308 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4301 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610114:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b489b87c00/0x5c74554e47ce4316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce430f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610120:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b489b87400/0x5c74554e47ce4324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce431d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610131:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b489b86000/0x5c74554e47ce432b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7d3 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610137:0:11160:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b489b87a00/0x5c74554e47ce4340 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa80b expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610144:0:11160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610202:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b489b87a00/0x5c74554e47ce4340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa80b expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610217:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b489b87a00/0x5c74554e47ce4340 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa80b expref: 12 pid: 5834 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129138.610252:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bab6cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1876037626547840:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129138.610410:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b489b86000/0x5c74554e47ce432b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7d3 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610419:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b489b86000/0x5c74554e47ce432b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7d3 expref: 12 pid: 5834 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129138.610429:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1876037626547968:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129138.610462:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b489b87400/0x5c74554e47ce4324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce431d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610471:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b489b87400/0x5c74554e47ce4324 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce431d expref: 18 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129138.610480:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902f83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1876037626548096:0@lo:104: 00000100:00100000:2.0:1789129138.610533:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789129138.610583:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b489b87c00/0x5c74554e47ce4316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce430f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610591:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b489b87c00/0x5c74554e47ce4316 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce430f expref: 18 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129138.610630:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b90f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1876037626548224:0@lo:104: 00000100:00100000:2.0:1789129138.610655:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789129138.610677:0:11160:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b489b86c00/0x5c74554e47ce4308 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4301 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129138.610686:0:11160:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b489b86c00/0x5c74554e47ce4308 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4301 expref: 18 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129138.610702:0:11160:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b91680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1876037626548352:0@lo:104: 00000100:00100000:2.0:1789129138.610726:0:11160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129138.610737:0:11160:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab840 going to sleep for 11 seconds 00000100:00100000:1.0:1789129138.612414:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626548096 00000100:00100000:1.0:1789129138.612432:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626548096 00000100:00100000:1.0:1789129138.612490:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626548224 00000100:00100000:1.0:1789129138.612494:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626548224 00000100:00100000:1.0:1789129138.612504:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626548352 00000100:00100000:1.0:1789129138.612507:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626548352 00000100:00100000:1.0:1789129138.612523:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789129138.612533:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:11160:x1876037626548096:12345-0@lo:104: 00010000:00010000:1.0:1789129138.612553:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.612686:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789129138.612693:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:11160:x1876037626548096:12345-0@lo:104: Request processed in 163us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129138.612717:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789129138.612736:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789129138.612742:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b90780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:11160:x1876037626548224:12345-0@lo:104: 00010000:00010000:1.0:1789129138.612750:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.612795:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789129138.612800:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b90780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:11160:x1876037626548224:12345-0@lo:104: Request processed in 59us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129138.612806:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789129138.612818:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789129138.612824:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:11160:x1876037626548352:12345-0@lo:104: 00010000:00010000:1.0:1789129138.612832:0:5823:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.612867:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789129138.612873:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:11160:x1876037626548352:12345-0@lo:104: Request processed in 50us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129138.612879:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789129138.613081:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789129138.613088:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613096:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129138.613100:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613120:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789129138.613128:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129138.613134:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789129138.613175:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613181:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789129138.613203:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613210:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4829d4600/0x5c74554e47ce431d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613224:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789129138.613227:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613233:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86400 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129138.613235:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613242:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789129138.613249:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129138.613260:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789129138.613289:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613295:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789129138.613324:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613332:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b489b86400/0x5c74554e47ce430f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4316 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613342:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129138.613345:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613351:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87e00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129138.613354:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613360:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789129138.613366:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129138.613370:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789129138.613382:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613388:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789129138.613402:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613407:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b489b87e00/0x5c74554e47ce4301 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4308 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613424:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129138.613426:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129138.613427:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129138.613435:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129138.613440:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129138.613467:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626548480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129138.613519:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129138.613574:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626548608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129138.613599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129138.613644:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789129138.613650:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626548736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129138.613676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129138.613712:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626548480 00000100:00100000:1.0:1789129138.613717:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626548480 00010000:00010000:1.0:1789129138.613741:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b489b87400/0x5c74554e47ce4324 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce431d expref: 19 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129138.613766:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626548608 00000100:00100000:1.0:1789129138.613770:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626548608 00010000:00010000:1.0:1789129138.613781:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b489b87c00/0x5c74554e47ce4316 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce430f expref: 20 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129138.613792:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626548736 00000100:00100000:1.0:1789129138.613794:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626548736 00010000:00010000:1.0:1789129138.613817:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b489b86c00/0x5c74554e47ce4308 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4301 expref: 21 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129138.613832:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789129138.613839:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+21:3309:x1876037626548480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789129138.613852:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129138.613858:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b489b87400/0x5c74554e47ce4324 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce431d expref: 21 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.613868:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b489b87400/0x5c74554e47ce4324 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce431d expref: 21 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129138.613872:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789129138.613888:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+21:3306:x1876037626548608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789129138.613890:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129138.613896:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129138.613900:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b489b87c00/0x5c74554e47ce4316 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce430f expref: 21 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129138.613909:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b489b87c00/0x5c74554e47ce4316 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce430f expref: 21 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129138.613917:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+21:3309:x1876037626548480:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (398us total) trans 0 rc 0/0 00010000:00010000:0.0:1789129138.613919:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129138.613924:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789129138.613946:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+20:3306:x1876037626548608:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129138.613952:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789129138.613965:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789129138.613970:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b96940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626548736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789129138.613977:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129138.613982:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b489b86c00/0x5c74554e47ce4308 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4301 expref: 19 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129138.613989:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b489b86c00/0x5c74554e47ce4308 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4301 expref: 19 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129138.613998:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129138.613999:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626548480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789129138.614016:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b96940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626548736:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129138.614022:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789129138.614044:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b96580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626548736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789129138.614052:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626548608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789129138.614303:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b87400/0x5c74554e47ce4324 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce431d expref: 18 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129138.614324:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902f83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1876037626548096:0@lo:104: 00010000:00010000:2.0:1789129138.614335:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b87c00/0x5c74554e47ce4316 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce430f expref: 17 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129138.614342:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b90f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1876037626548224:0@lo:104: 00010000:00010000:2.0:1789129138.614351:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b86c00/0x5c74554e47ce4308 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4301 expref: 16 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129138.614359:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b91680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1876037626548352:0@lo:104: 00000100:00100000:3.0:1789129138.626184:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bab6cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1876037626547840:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129138.626200:0:11160:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11160:1876037626547968:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129138.626237:0:11160:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129138.636775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129138.636849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129138.636892:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604491008 00000100:00100000:1.0:1789129138.636905:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604491008 00010000:00010000:1.0:1789129138.636972:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b489b87a00/0x5c74554e47ce4340 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa80b expref: 13 pid: 5834 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129138.637014:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604491136 00000100:00100000:1.0:1789129138.637018:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604491136 00010000:00010000:1.0:1789129138.637033:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b489b86000/0x5c74554e47ce432b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7d3 expref: 14 pid: 5834 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129138.637061:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:1.0:1789129138.637071:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+14:2369:x1876037604491008:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129138.637099:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129138.637106:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b489b87a00/0x5c74554e47ce4340 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa80b expref: 14 pid: 5834 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637123:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b489b87a00/0x5c74554e47ce4340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa80b expref: 14 pid: 5834 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637143:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b87a00/0x5c74554e47ce4340 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa80b expref: 14 pid: 5834 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637161:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129138.637224:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604491008:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 154us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129138.637232:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:1.0:1789129138.637250:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1789129138.637268:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad14b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+12:2369:x1876037604491136:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129138.637277:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129138.637282:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b489b86000/0x5c74554e47ce432b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7d3 expref: 12 pid: 5834 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637291:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b489b86000/0x5c74554e47ce432b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7d3 expref: 12 pid: 5834 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637302:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b86000/0x5c74554e47ce432b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7d3 expref: 12 pid: 5834 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637324:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637343:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637362:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637370:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637377:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637384:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637390:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129138.637396:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637406:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637421:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129138.637434:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129138.637469:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad14b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+11:2369:x1876037604491136:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 213us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129138.637477:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00010000:00010000:3.0:1789129138.637723:0:11160:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129138.637734:0:11160:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129138.637742:0:11160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce435c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129139.400416:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129139.466739:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626548864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129139.466849:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129139.472649:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626548864 00000100:00100000:2.0:1789129139.472671:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626548864 00000100:00100000:2.0:1789129139.472767:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789129139.472778:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626548864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129139.472825:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129139.472942:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626548864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (6093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129139.472951:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789129139.474079:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b5b93c00 x1876037626548864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129139.474115:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626548864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789129139.475161:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129140.187703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129140.187830:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604491264 00000100:00100000:1.0:1789129140.187842:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604491264 00000100:00100000:1.0:1789129140.187909:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:1.0:1789129140.187921:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+11:5613:x1876037604491264:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789129140.187941:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129140.187967:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b481656e00/0x5c74554e47ce4363 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa835 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129140.187998:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656e00/0x5c74554e47ce4363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa835 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129140.188011:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b481656e00/0x5c74554e47ce4363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa835 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129140.188021:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656e00, rc 0) 00000100:00100000:1.0:1789129140.188079:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604491264:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 160us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129140.188086:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:2.0:1789129140.193492:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129140.193594:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604491392 00000100:00100000:1.0:1789129140.193623:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604491392 00000100:00100000:1.0:1789129140.193677:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 241 00000100:00100000:1.0:1789129140.193688:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604491392:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129140.194037:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604491392:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 349us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129140.194055:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 241 00000100:00100000:3.0:1789129140.202554:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129140.209852:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604491520 00000100:00100000:2.0:1789129140.209878:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604491520 00000100:00100000:0.0:1789129140.216790:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 242 00000100:00100000:0.0:1789129140.216807:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604491520:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129140.217061:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604491520:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 257us (15152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129140.217069:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 242 00000100:00100000:1.0:1789129140.232174:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129140.237446:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604491648 00000100:00100000:2.0:1789129140.237464:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604491648 00000100:00100000:2.0:1789129140.237589:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00100000:2.0:1789129140.237614:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604491648:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129140.237632:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129140.237652:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151b000/0x5c74554e47ce436a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa83c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129140.237687:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151b000/0x5c74554e47ce436a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa83c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129140.237699:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151b000/0x5c74554e47ce436a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa83c expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129140.237709:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b000, rc 0) 00000100:00100000:2.0:1789129140.237787:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604491648:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 188us (5625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129140.237795:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 243 00000100:00100000:3.0:1789129140.247039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129140.247334:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604491776 00000100:00100000:1.0:1789129140.247346:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604491776 00000100:00100000:1.0:1789129140.247406:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 244 00000100:00100000:1.0:1789129140.247417:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604491776:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129140.247864:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604491776:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 327us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129140.247874:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 244 00000100:00100000:3.0:1789129140.252237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129140.254719:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604491904 00000100:00100000:2.0:1789129140.254733:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604491904 00000100:00100000:2.0:1789129140.254814:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 245 00000100:00100000:2.0:1789129140.254826:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604491904:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129140.255069:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604491904:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 244us (2858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129140.255079:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 245 00010000:00010000:3.0:1789129140.424168:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789129140.553500:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789129140.553516:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b3812fb000 from 7 10000000:01000000:0.0:1789129140.553522:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789129140.553599:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129140.553637:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129140.553651:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129140.553693:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626548992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789129140.553789:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129140.553846:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b57590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129140.554052:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626548992 00000100:00100000:2.0:1789129140.554061:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626548992 00000100:00100000:2.0:1789129140.554128:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789129140.554147:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626548992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129140.554162:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129140.554176:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce4378 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce4371 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129140.554199:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce4378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce4371 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129140.554209:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce4378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4371 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129140.554218:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151ac00, rc 0) 00000100:00100000:2.0:1789129140.554285:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626548992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129140.554292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789129140.554340:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626548992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789129140.554367:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129140.554379:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129140.554461:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b95a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129140.554497:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129140.554537:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584840 going to sleep for 11 seconds 00000100:00100000:2.0:1789129140.554596:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626549120 00000100:00100000:2.0:1789129140.554618:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626549120 00000100:00100000:2.0:1789129140.554645:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789129140.554652:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626549120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129140.555059:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626549120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129140.555065:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789129140.557161:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b95a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129140.557501:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b95a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129140.557583:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129140.557653:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584840 going to sleep for 11 seconds 00000100:00100000:3.0:1789129140.557724:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626549248 00000100:00100000:3.0:1789129140.557731:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626549248 00000100:00100000:3.0:1789129140.557834:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789129140.557845:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626549248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129140.558046:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626549248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129140.558055:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789129140.558068:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b95a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789129140.558895:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789129140.558989:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789129140.559017:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789129140.559032:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129140.559057:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129140.559069:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789129140.559072:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b492084000 from 7 10000000:01000000:0.0:1789129140.559077:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789129140.559134:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129140.559141:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129140.559148:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129140.559165:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490230f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789129140.559216:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129140.559265:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0b43300 going to sleep for 11 seconds 00000100:00100000:1.0:1789129140.559357:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626549376 00000100:00100000:1.0:1789129140.559364:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626549376 00000100:00100000:1.0:1789129140.559405:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789129140.559414:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626549376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789129140.559428:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129140.559444:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b481656800/0x5c74554e47ce4386 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce437f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129140.559469:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656800/0x5c74554e47ce4386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce437f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129140.559480:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b481656800/0x5c74554e47ce4386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce437f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129140.559487:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656800, rc 0) 00000100:00100000:1.0:1789129140.559523:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626549376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129140.559529:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789129140.559589:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490230f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129140.559660:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129140.559667:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129140.559712:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490230f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129140.559731:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129140.559807:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0b43300 going to sleep for 11 seconds 00000100:00100000:0.0:1789129140.559818:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626549504 00000100:00100000:0.0:1789129140.559822:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626549504 00000100:00100000:0.0:1789129140.559852:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789129140.559858:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626549504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789129140.560118:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626549504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129140.560125:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789129140.560326:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490230f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129140.560353:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490230f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129140.560397:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129140.562865:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c0b43300 going to sleep for 11 seconds 00000100:00100000:1.0:1789129140.566374:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626549632 00000100:00100000:1.0:1789129140.566408:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626549632 00000100:00100000:1.0:1789129140.566517:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789129140.566534:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626549632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129140.568367:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626549632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1827us (7959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129140.568384:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789129140.572394:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490230f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789129140.579728:0:11186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789129140.579863:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789129140.579895:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789129140.579907:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129140.579932:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129140.579944:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789129140.579947:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4921dd800 from 7 10000000:01000000:2.0:1789129140.579950:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789129140.580009:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129140.580017:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129140.580028:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129140.580056:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789129140.580125:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129140.580162:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129140.580298:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626549760 00000100:00100000:3.0:1789129140.580307:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626549760 00000100:00100000:3.0:1789129140.580363:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789129140.580371:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626549760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129140.580387:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129140.580404:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce4394 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce438d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129140.580428:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce4394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce438d expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129140.580438:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce4394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce438d expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129140.580451:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2a00, rc 0) 00000100:00100000:3.0:1789129140.580493:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626549760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129140.580499:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789129140.581135:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129140.581157:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129140.581168:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129140.581226:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490230b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129140.581287:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129140.581325:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4887e7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129140.581728:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626549888 00000100:00100000:1.0:1789129140.581742:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626549888 00000100:00100000:1.0:1789129140.581771:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789129140.581778:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626549888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129140.582160:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626549888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129140.582167:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789129140.582203:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490230b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626549888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129140.582248:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626550016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129140.582297:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129140.582337:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129140.582399:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626550016 00000100:00100000:1.0:1789129140.582403:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626550016 00000100:00100000:1.0:1789129140.582420:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789129140.582426:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626550016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129140.582574:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626550016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129140.582581:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789129140.582814:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626550016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789129140.584168:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789129140.584402:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789129140.584434:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789129140.584450:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129140.584463:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129140.998797:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626550144:0@lo:400:kworker.0 00000100:00100000:1.0:1789129140.998905:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129140.998963:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626550656:0@lo:400:kworker.0 00000100:00100000:1.0:1789129140.998992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129140.999024:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789129140.999030:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626550528:0@lo:400:kworker.0 00000100:00100000:1.0:1789129140.999059:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129140.999092:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626550400:0@lo:400:kworker.0 00000100:00100000:1.0:1789129140.999125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129140.999143:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789129140.999149:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626550272:0@lo:400:kworker.0 00000100:00100000:1.0:1789129140.999170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129140.999187:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626550784:0@lo:400:kworker.0 00000100:00100000:1.0:1789129140.999206:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129140.999236:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626550144 00000100:00100000:1.0:1789129140.999258:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626550144 00000100:00100000:1.0:1789129140.999315:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789129140.999324:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626550144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129140.999372:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626550144:12345-0@lo:400:kworker.0 Request processed in 50us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129140.999380:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789129140.999412:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626550528 00000100:00100000:1.0:1789129140.999417:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626550528 00000100:00100000:1.0:1789129140.999440:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626550784 00000100:00100000:1.0:1789129140.999443:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626550784 00000100:00100000:1.0:1789129140.999466:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789129140.999473:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626550528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129140.999504:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626550528:12345-0@lo:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129140.999511:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789129140.999522:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789129140.999528:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626550784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129140.999558:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b97840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626550784:12345-0@lo:400:kworker.0 Request processed in 31us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129140.999564:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789129140.999622:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b5b943c0 x1876037626550784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129140.999637:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626550784:0@lo:400:kworker.0 00010000:00080000:1.0:1789129140.999664:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b5b94780 x1876037626550528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129140.999672:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b94780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626550528:0@lo:400:kworker.0 00000100:00100000:1.0:1789129140.999691:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626550144:0@lo:400:kworker.0 00000100:00080000:0.0:1789129140.999920:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129140.999983:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626550656 00000100:00100000:0.0:1789129140.999987:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626550656 00000100:00100000:0.0:1789129141.000034:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626550400 00000100:00100000:0.0:1789129141.000038:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626550400 00000100:00100000:0.0:1789129141.000052:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626550272 00000100:00100000:0.0:1789129141.000061:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626550272 00000100:00100000:0.0:1789129141.000077:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789129141.000084:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626550656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129141.000140:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626550656:12345-0@lo:400:kworker.0 Request processed in 56us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129141.000146:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789129141.000159:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789129141.000165:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626550400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129141.000197:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626550400:12345-0@lo:400:kworker.0 Request processed in 32us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129141.000203:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789129141.000213:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789129141.000218:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626550272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129141.000243:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626550272:12345-0@lo:400:kworker.0 Request processed in 26us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129141.000249:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789129141.000296:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626550272:0@lo:400:kworker.0 00000100:00100000:0.0:1789129141.000307:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626550400:0@lo:400:kworker.0 00000100:00100000:0.0:1789129141.000332:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626550656:0@lo:400:kworker.0 00000100:00080000:1.0:1789129141.002215:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129141.005254:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626550912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129141.005391:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129141.005584:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626550912 00000100:00100000:1.0:1789129141.005598:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626550912 00000100:00100000:1.0:1789129141.005709:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789129141.005722:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626550912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129141.005779:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129141.021237:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626550912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15502us (15832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129141.021257:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1789129141.021640:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b5b930c0 x1876037626550912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129141.021674:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626550912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789129141.446538:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129142.472703:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129143.334929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129143.334975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129143.335047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604492032 00000100:00100000:3.0:1789129143.335057:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604492032 00000100:00100000:3.0:1789129143.335158:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 256 00000100:00100000:3.0:1789129143.335169:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604492032:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129143.335263:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604492032:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 96us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129143.335272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 256 00000100:00100000:0.0:1789129143.335350:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604492288 00000100:00100000:0.0:1789129143.335355:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604492288 00000100:00100000:0.0:1789129143.335401:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:0.0:1789129143.335408:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604492288:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129143.335441:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604492288:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129143.335447:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00080000:0.0:1789129143.335465:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129143.340235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129143.345445:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604492160 00000100:00100000:0.0:1789129143.345475:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604492160 00000100:00100000:1.0:1789129143.345690:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:1.0:1789129143.345703:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604492160:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129143.345802:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604492160:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 101us (5589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129143.345810:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00080000:0.0:1789129143.346568:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789129143.493791:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129144.521488:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789129144.532143:0:11358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789129144.585594:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490230b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626551040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129144.585711:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129144.585803:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626551040 00000100:00100000:3.0:1789129144.585814:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626551040 00000100:00100000:3.0:1789129144.585889:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789129144.585901:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626551040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129144.585948:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129144.586017:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626551040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129144.586035:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789129144.586224:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b490230b40 x1876037626551040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129144.586249:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490230b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626551040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789129144.587628:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789129145.544070:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129146.117884:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626551552:0@lo:400:kworker.0 00000100:00100000:1.0:1789129146.117987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129146.118067:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789129146.118075:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626551168:0@lo:400:kworker.0 00000100:00100000:1.0:1789129146.118111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129146.118134:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626551680:0@lo:400:kworker.0 00000100:00100000:1.0:1789129146.118160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129146.118201:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626551296:0@lo:400:kworker.0 00000100:00100000:1.0:1789129146.118246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129146.118268:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626551808:0@lo:400:kworker.0 00000100:00100000:1.0:1789129146.118295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129146.118318:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789129146.118325:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626551424:0@lo:400:kworker.0 00000100:00100000:3.0:1789129146.118340:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626551680 00000100:00100000:3.0:1789129146.118350:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626551680 00000100:00100000:1.0:1789129146.118352:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129146.118385:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626551296 00000100:00100000:1.0:1789129146.118391:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626551296 00000100:00100000:1.0:1789129146.118423:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626551424 00000100:00100000:1.0:1789129146.118426:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626551424 00000100:00100000:3.0:1789129146.118431:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789129146.118445:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626551680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129146.118452:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789129146.118461:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626551296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129146.118525:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626551680:12345-0@lo:400:kworker.0 Request processed in 84us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129146.118528:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626551296:12345-0@lo:400:kworker.0 Request processed in 66us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129146.118540:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789129146.118765:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626551936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129146.118855:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129146.118890:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626551552 00000100:00100000:2.0:1789129146.118894:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626551552 00000100:00100000:2.0:1789129146.118926:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626551808 00000100:00100000:2.0:1789129146.118929:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626551808 00000100:00100000:2.0:1789129146.118947:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789129146.118954:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626551552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129146.118988:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b96580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626551552:12345-0@lo:400:kworker.0 Request processed in 35us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129146.118995:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789129146.119010:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789129146.119016:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626551808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129146.119045:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626551808:12345-0@lo:400:kworker.0 Request processed in 29us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129146.119050:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789129146.119068:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626551168 00000100:00100000:2.0:1789129146.119072:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626551168 00000100:00100000:2.0:1789129146.119097:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789129146.119104:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626551168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129146.119132:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626551168:12345-0@lo:400:kworker.0 Request processed in 29us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129146.119138:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:2.0:1789129146.119191:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789129146.119197:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789129146.119207:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129146.119278:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789129146.119297:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789129146.119308:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626551424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129146.119322:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626551936 00000100:00100000:1.0:1789129146.119327:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626551936 00000100:00100000:3.0:1789129146.119357:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626551424:12345-0@lo:400:kworker.0 Request processed in 51us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129146.119358:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789129146.119366:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789129146.119380:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626551936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129146.119420:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129146.119439:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b94f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626551424:0@lo:400:kworker.0 00000100:00100000:3.0:1789129146.119456:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626551296:0@lo:400:kworker.0 00000100:00100000:1.0:1789129146.119471:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626551936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (614us total) trans 0 rc 0/0 00010000:00080000:3.0:1789129146.119476:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b5b961c0 x1876037626551808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129146.119482:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789129146.119493:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626551808:0@lo:400:kworker.0 00010000:00080000:1.0:1789129146.119532:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b5b90000 x1876037626551936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129146.119535:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626551168:0@lo:400:kworker.0 00000100:00100000:3.0:1789129146.119556:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626551680:0@lo:400:kworker.0 00000100:00100000:1.0:1789129146.119557:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626551936:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789129146.119578:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b5b96d00 x1876037626551552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129146.119589:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626551552:0@lo:400:kworker.0 00010000:00010000:2.0:1789129146.565974:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129147.589717:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129148.449718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129148.449761:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129148.449795:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129148.449825:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604492672 00000100:00100000:0.0:1789129148.449835:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604492672 00000100:00100000:0.0:1789129148.449900:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604492544 00000100:00100000:0.0:1789129148.449903:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604492544 00000100:00100000:0.0:1789129148.449928:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:0.0:1789129148.449952:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2370:x1876037604492672:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129148.450052:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2370:x1876037604492672:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 114us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129148.450060:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:0.0:1789129148.450078:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:0.0:1789129148.450097:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604492544:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129148.450124:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604492544:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129148.450159:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00080000:0.0:1789129148.450183:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129148.453208:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604492416 00000100:00100000:3.0:1789129148.453228:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604492416 00000100:00100000:3.0:1789129148.453334:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 258 00000100:00100000:3.0:1789129148.453345:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604492416:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129148.453444:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604492416:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 101us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129148.453452:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 258 00010000:00010000:1.0:1789129148.614382:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129149.640974:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129149.702193:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789129149.702215:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626552064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129149.702302:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129149.702374:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626552064 00000100:00100000:2.0:1789129149.702381:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626552064 00000100:00100000:2.0:1789129149.702431:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789129149.702440:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626552064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129149.702476:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129149.702522:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626552064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129149.702529:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789129149.702565:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b5b92580 x1876037626552064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129149.702585:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626552064:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789129149.703206:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789129150.630829:0:11602:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc94d73200 20000000:00000080:3.0:1789129150.630862:0:11602:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b4a7829c00 uarg=0000000000000000 20000000:01000000:3.0:1789129150.630909:0:11602:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789129150.630916:0:11602:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789129150.630922:0:11602:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789129150.634768:0:11603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789129150.634945:0:11602:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:1.0:1789129150.646018:0:11602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789129150.646115:0:11602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:1.0:1789129150.646179:0:11602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:1.0:1789129150.646200:0:11602:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789129150.646218:0:11602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646233:0:11602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b481656e00/0x5c74554e47ce4363 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa835 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646239:0:11602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b48151b000/0x5c74554e47ce436a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa83c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646244:0:11602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce4378 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce4371 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646247:0:11602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b481656800/0x5c74554e47ce4386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce437f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646251:0:11602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce4394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce438d expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646266:0:11602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646305:0:11602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce4394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce438d expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646322:0:11602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce4394 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce438d expref: 18 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129150.646334:0:11602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11602:1876037626552192:0@lo:104: 00000100:00100000:1.0:1789129150.646387:0:11602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789129150.646447:0:11602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b481656800/0x5c74554e47ce4386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce437f expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129150.646452:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626552192 00010000:00010000:1.0:1789129150.646455:0:11602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b481656800/0x5c74554e47ce4386 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce437f expref: 18 pid: 5833 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129150.646460:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626552192 00000100:00100000:1.0:1789129150.646462:0:11602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11602:1876037626552320:0@lo:104: 00000100:00100000:1.0:1789129150.646483:0:11602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129150.646506:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626552320 00000100:00100000:2.0:1789129150.646509:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626552320 00010000:00010000:1.0:1789129150.646512:0:11602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce4378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce4371 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646520:0:11602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce4378 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce4371 expref: 18 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129150.646525:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789129150.646528:0:11602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11602:1876037626552448:0@lo:104: 00000100:00100000:2.0:1789129150.646533:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:11602:x1876037626552192:12345-0@lo:104: 00010000:00010000:2.0:1789129150.646546:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129150.646549:0:11602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789129150.646565:0:11602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b48151b000/0x5c74554e47ce436a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa83c expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646585:0:11602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b48151b000/0x5c74554e47ce436a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa83c expref: 12 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129150.646595:0:11602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11602:1876037626552576:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129150.646678:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789129150.646684:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:11602:x1876037626552192:12345-0@lo:104: Request processed in 153us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129150.646698:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789129150.646700:0:11602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b481656e00/0x5c74554e47ce4363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa835 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129150.646707:0:11602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b481656e00/0x5c74554e47ce4363 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa835 expref: 12 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129150.646715:0:11602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11602:1876037626552704:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129150.646720:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789129150.646730:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626552448 00000100:00100000:2.0:1789129150.646733:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626552448 00000100:00100000:2.0:1789129150.646748:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789129150.646753:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:11602:x1876037626552320:12345-0@lo:104: 00010000:00010000:2.0:1789129150.646761:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.646862:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789129150.646871:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.646878:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ba00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789129150.646882:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.646890:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129150.646907:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129150.646912:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789129150.646981:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.646987:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789129150.647010:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.647016:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151ba00/0x5c74554e47ce438d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4394 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.647029:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129150.647039:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.647129:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3e00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789129150.647133:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.647141:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129150.647148:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129150.647153:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789129150.647305:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789129150.647313:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:11602:x1876037626552320:12345-0@lo:104: Request processed in 558us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129150.647320:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789129150.647341:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789129150.647351:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:11602:x1876037626552448:12345-0@lo:104: 00010000:00010000:2.0:1789129150.647360:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.647402:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789129150.647407:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490aa5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:11602:x1876037626552448:12345-0@lo:104: Request processed in 60us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129150.647412:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789129150.647461:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626552832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789129150.647491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789129150.647523:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129150.647529:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.647545:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5c00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129150.647549:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.647556:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129150.647561:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129150.647565:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789129150.649641:0:11602:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129150.649680:0:11602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11602:1876037626552192:0@lo:104: 00010000:00010000:3.0:1789129150.649684:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129150.649689:0:11602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11602:1876037626552320:0@lo:104: 00000100:00100000:1.0:1789129150.649809:0:11602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11602:1876037626552448:0@lo:104: 00010000:00010000:0.0:1789129150.650845:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.650858:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789129150.650885:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.650892:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf3e00/0x5c74554e47ce437f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4386 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.650916:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129150.650918:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129150.650921:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129150.651400:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626552960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789129150.651464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789129150.651651:0:5828:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.651661:0:5828:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129150.651674:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.651682:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4829d5c00/0x5c74554e47ce4371 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce4378 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.651700:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129150.651702:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129150.651704:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129150.651718:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626552832 00000100:00100000:2.0:1789129150.651725:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626552832 00010000:00010000:2.0:1789129150.651754:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce4394 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce438d expref: 19 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129150.651777:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626552960 00000100:00100000:2.0:1789129150.651797:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626552960 00010000:00010000:2.0:1789129150.651811:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b481656800/0x5c74554e47ce4386 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce437f expref: 20 pid: 5833 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129150.651834:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789129150.651843:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+20:3309:x1876037626552832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789129150.651859:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129150.651864:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce4394 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce438d expref: 20 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.651877:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce4394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce438d expref: 20 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.651893:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce4394 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce438d expref: 20 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.651906:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129150.651952:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b92d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626552832:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (4459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129150.651959:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789129150.651976:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789129150.651982:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:3306:x1876037626552960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789129150.651990:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129150.651995:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b481656800/0x5c74554e47ce4386 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce437f expref: 18 pid: 5833 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.652004:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b481656800/0x5c74554e47ce4386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce437f expref: 18 pid: 5833 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.652013:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656800/0x5c74554e47ce4386 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce437f expref: 18 pid: 5833 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.652034:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129150.652423:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3306:x1876037626552960:12345-0@lo:103:ldlm_bl.0 Request processed in 440us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129150.652430:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789129150.652476:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626552832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789129150.652509:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626552960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789129150.652519:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789129150.652526:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626553088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789129150.652555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129150.652737:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626553088 00000100:00100000:0.0:1789129150.652743:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626553088 00010000:00010000:0.0:1789129150.652765:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce4378 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4371 expref: 17 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129150.652807:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789129150.652814:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3306:x1876037626553088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789129150.652823:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129150.652827:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce4378 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce4371 expref: 17 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.652836:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce4378 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce4371 expref: 17 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.652847:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151ac00/0x5c74554e47ce4378 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce4371 expref: 17 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.652858:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129150.652891:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3306:x1876037626553088:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129150.652897:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789129150.653218:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626553088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789129150.655947:0:11602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11602:1876037626552576:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129150.655976:0:11602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11602:1876037626552704:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129150.656015:0:11602:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129150.657591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129150.658209:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604492800 00000100:00100000:2.0:1789129150.658220:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604492800 00010000:00010000:2.0:1789129150.658331:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b48151b000/0x5c74554e47ce436a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa83c expref: 13 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129150.658378:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789129150.658388:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604492800:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129150.658404:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129150.658411:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b48151b000/0x5c74554e47ce436a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa83c expref: 13 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.658423:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b48151b000/0x5c74554e47ce436a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa83c expref: 13 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.658443:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151b000/0x5c74554e47ce436a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa83c expref: 13 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129150.658475:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129150.658687:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39f4e36-8626-43c5-a083-60799197f867+12:2369:x1876037604492800:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 299us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129150.658697:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789129150.658771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129150.659519:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604492928 00000100:00100000:0.0:1789129150.659529:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604492928 00010000:00010000:0.0:1789129150.659559:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b481656e00/0x5c74554e47ce4363 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa835 expref: 12 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129150.659595:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:0.0:1789129150.659626:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b90780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39f4e36-8626-43c5-a083-60799197f867+12:2369:x1876037604492928:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129150.659639:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129150.659644:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b481656e00/0x5c74554e47ce4363 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa835 expref: 12 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659670:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b481656e00/0x5c74554e47ce4363 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa835 expref: 12 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659687:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656e00/0x5c74554e47ce4363 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa835 expref: 12 pid: 5833 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659708:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659716:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659744:0:8444:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659751:0:8444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659759:0:8444:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659765:0:8444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659770:0:8444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129150.659774:0:8444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659783:0:8444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659811:0:8444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.659823:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129150.660878:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b90780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39f4e36-8626-43c5-a083-60799197f867+11:2369:x1876037604492928:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1264us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129150.660892:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00010000:00010000:3.0:1789129150.661356:0:11602:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129150.661367:0:11602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129150.661374:0:11602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656000/0x5c74554e47ce439b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129150.662933:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129151.238126:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626553600:0@lo:400:kworker.0 00000100:00100000:1.0:1789129151.238221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129151.238543:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626553344:0@lo:400:kworker.0 00000100:00100000:2.0:1789129151.238577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129151.239167:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789129151.239177:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626553472:0@lo:400:kworker.0 00000100:00100000:1.0:1789129151.239214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129151.239237:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626553984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129151.239280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129151.243363:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626553216:0@lo:400:kworker.0 00000100:00100000:0.0:1789129151.243548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129151.243628:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626553728:0@lo:400:kworker.0 00000100:00100000:0.0:1789129151.243662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129151.243708:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626553344 00000100:00100000:0.0:1789129151.243716:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626553344 00000100:00100000:2.0:1789129151.244002:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626553856:0@lo:400:kworker.0 00000100:00100000:2.0:1789129151.244052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129151.244103:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626553600 00000100:00100000:2.0:1789129151.244109:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626553600 00000100:00100000:2.0:1789129151.244159:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626553856 00000100:00100000:2.0:1789129151.244162:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626553856 00000100:00100000:2.0:1789129151.244181:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789129151.244190:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626553600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129151.244267:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626553600:12345-0@lo:400:kworker.0 Request processed in 77us (6045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129151.244274:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789129151.244293:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789129151.244300:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626553856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129151.244332:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626553856:12345-0@lo:400:kworker.0 Request processed in 32us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129151.244337:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789129151.244357:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626553984 00000100:00100000:2.0:1789129151.244361:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626553984 00000100:00100000:2.0:1789129151.244400:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789129151.244420:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626553984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129151.244456:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129151.244491:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626553984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (5210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129151.244497:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1789129151.244538:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a79f9680 x1876037626553856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129151.244553:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626553856:0@lo:400:kworker.0 00010000:00080000:2.0:1789129151.244585:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b5b903c0 x1876037626553984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129151.244622:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626553984:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789129151.244636:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a79fb0c0 x1876037626553600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129151.244644:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626553600:0@lo:400:kworker.0 00000100:00100000:0.0:1789129151.245328:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626553472 00000100:00100000:0.0:1789129151.245338:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626553472 00000100:00100000:0.0:1789129151.245375:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626553728 00000100:00100000:0.0:1789129151.245380:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626553728 00000100:00100000:0.0:1789129151.245396:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789129151.245836:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626553344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129151.246123:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626553344:12345-0@lo:400:kworker.0 Request processed in 636us (7462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129151.246132:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789129151.246154:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789129151.246162:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626553472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129151.246200:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626553472:12345-0@lo:400:kworker.0 Request processed in 40us (6985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129151.246216:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789129151.246228:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789129151.246235:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626553728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129151.247020:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626553728:12345-0@lo:400:kworker.0 Request processed in 780us (3351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129151.247188:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1789129151.250563:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789129151.250574:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789129151.250577:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129151.250640:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626553216 00000100:00100000:1.0:1789129151.250651:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626553216 00000100:00100000:1.0:1789129151.250833:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789129151.250845:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3308:x1876037626553216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129151.251187:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3308:x1876037626553216:12345-0@lo:400:kworker.0 Request processed in 342us (7637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129151.251195:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789129151.251698:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626553344:0@lo:400:kworker.0 00000100:00100000:0.0:1789129151.252350:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626553216:0@lo:400:kworker.0 00000100:00100000:0.0:1789129151.252378:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626553728:0@lo:400:kworker.0 00000100:00100000:0.0:1789129151.253012:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626553472:0@lo:400:kworker.0 00010000:00010000:0.0:1789129151.685789:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789129151.947382:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789129151.947391:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b3812fb000 from 7 10000000:01000000:3.0:1789129151.947396:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789129151.947441:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129151.947450:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129151.947465:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129151.947486:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626554112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789129151.947546:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129151.947579:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5759300 going to sleep for 11 seconds 00000100:00100000:3.0:1789129151.947594:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626554112 00000100:00100000:3.0:1789129151.947599:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626554112 00000100:00100000:3.0:1789129151.947649:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789129151.947656:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626554112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129151.947668:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129151.947678:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce43a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce43a2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129151.947696:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce43a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce43a2 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129151.947706:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce43a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce43a2 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129151.947716:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3400, rc 0) 00000100:00100000:3.0:1789129151.947751:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626554112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129151.947757:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789129151.947796:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626554112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129151.947810:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129151.947824:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129151.947873:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626554240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129151.947892:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129151.947902:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5759300 going to sleep for 11 seconds 00000100:00100000:3.0:1789129151.947912:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626554240 00000100:00100000:3.0:1789129151.947914:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626554240 00000100:00100000:3.0:1789129151.947928:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789129151.947932:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626554240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129151.948172:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626554240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129151.948177:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789129151.948204:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626554240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129151.948232:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626554368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129151.948268:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129151.948281:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5759300 going to sleep for 11 seconds 00000100:00100000:3.0:1789129151.948291:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626554368 00000100:00100000:3.0:1789129151.948294:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626554368 00000100:00100000:3.0:1789129151.948311:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789129151.948317:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626554368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129151.948441:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626554368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129151.948447:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789129151.948483:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626554368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129151.951219:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad14b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11665:1876037626554496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129151.951319:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129151.955259:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129151.959557:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626554496 00000100:00100000:3.0:1789129151.959574:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626554496 00000100:00100000:3.0:1789129151.960213:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789129151.960228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:11665:x1876037626554496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129151.960587:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:11665:x1876037626554496:12345-0@lo:502:llog_process_th.0 Request processed in 362us (9267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129151.960595:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789129151.960790:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad14b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11665:1876037626554496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789129151.960842:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789129151.960857:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129151.960859:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789129151.960869:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b3812fb000 00000020:00000080:0.0:1789129151.960872:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789129151.960994:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad14b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11665:1876037626554624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129151.961051:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129151.966135:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129151.966284:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626554624 00000100:00100000:3.0:1789129151.966298:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626554624 00000100:00100000:3.0:1789129151.966367:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789129151.966377:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:11665:x1876037626554624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129151.967856:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:11665:x1876037626554624:12345-0@lo:502:llog_process_th.0 Request processed in 1472us (6795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129151.967871:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789129151.968904:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad14b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11665:1876037626554624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789129151.971059:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789129151.971086:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129151.971089:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789129151.971096:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789129151.971182:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789129151.971203:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789129151.971215:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129151.971226:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129151.971237:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789129151.971240:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b492084000 from 7 10000000:01000000:0.0:1789129151.971242:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789129151.971281:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129151.971288:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129151.971298:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129151.971325:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad14b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626554752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789129151.971403:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129151.971445:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789129151.971466:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626554752 00000100:00100000:0.0:1789129151.971472:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626554752 00000100:00100000:0.0:1789129151.971523:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789129151.971545:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626554752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789129151.971562:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129151.971575:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4829d4a00/0x5c74554e47ce43b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce43b0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129151.971919:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d4a00/0x5c74554e47ce43b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce43b0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129151.971932:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4829d4a00/0x5c74554e47ce43b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce43b0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129151.971941:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4a00, rc 0) 00000100:00100000:0.0:1789129151.972046:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626554752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 503us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129151.972053:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789129151.977539:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad14b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626554752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129151.977637:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129151.977650:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129151.977756:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626554880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129151.977842:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129151.986214:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129151.990270:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626554880 00000100:00100000:0.0:1789129151.990287:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626554880 00000100:00100000:0.0:1789129151.990346:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789129151.990357:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626554880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789129151.990720:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626554880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (12877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129151.990729:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789129151.991211:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626554880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129151.991269:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626555008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129151.991315:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129151.991347:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129151.991361:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626555008 00000100:00100000:2.0:1789129151.991365:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626555008 00000100:00100000:2.0:1789129151.991393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789129151.991399:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626555008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129151.991562:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626555008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129151.991570:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789129151.991628:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626555008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129151.991840:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11668:1876037626555136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129151.991882:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129151.991906:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626555136 00000100:00100000:2.0:1789129151.991910:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626555136 00000100:00100000:2.0:1789129151.991934:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789129151.991941:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:11668:x1876037626555136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129151.992098:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:11668:x1876037626555136:12345-0@lo:502:llog_process_th.0 Request processed in 156us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129151.992106:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789129151.992146:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29600 going to sleep for 11 seconds 00000100:00100000:2.0:1789129151.992158:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11668:1876037626555136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129151.992188:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129151.992202:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129151.992205:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789129151.992213:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b492084000 00000020:00000080:2.0:1789129151.992216:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789129151.992314:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11668:1876037626555264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129151.992348:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129151.992368:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626555264 00000100:00100000:2.0:1789129151.992372:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626555264 00000100:00100000:2.0:1789129151.992394:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789129151.992399:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:11668:x1876037626555264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129151.992513:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:11668:x1876037626555264:12345-0@lo:502:llog_process_th.0 Request processed in 112us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129151.992520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789129151.992552:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4881cec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129151.992563:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11668:1876037626555264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129151.992580:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129151.992585:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129151.992587:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789129151.992591:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789129151.992675:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789129151.992694:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789129151.992704:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129151.992715:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129151.992736:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789129151.992739:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4921dd800 from 7 10000000:01000000:2.0:1789129151.992741:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789129151.992766:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129151.992774:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129151.992783:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129151.992797:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626555392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789129151.992825:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129151.992838:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29600 going to sleep for 11 seconds 00000100:00100000:2.0:1789129151.992849:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626555392 00000100:00100000:2.0:1789129151.992853:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626555392 00000100:00100000:2.0:1789129151.992873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789129151.992879:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626555392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129151.992888:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129151.992901:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151b400/0x5c74554e47ce43c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce43be expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129151.992923:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151b400/0x5c74554e47ce43c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce43be expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129151.992934:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151b400/0x5c74554e47ce43c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce43be expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129151.992954:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b400, rc 0) 00000100:00100000:2.0:1789129151.992986:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626555392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129151.992992:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789129151.993024:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626555392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129151.993038:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129151.993046:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129151.997711:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626555520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129151.997798:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129151.997854:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29600 going to sleep for 11 seconds 00000100:00100000:3.0:1789129151.999384:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626555520 00000100:00100000:3.0:1789129151.999401:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626555520 00000100:00100000:3.0:1789129151.999462:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789129151.999474:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626555520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129151.999881:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626555520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 406us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129151.999890:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789129151.999961:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b903c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626555520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129152.000024:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626555648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129152.000083:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129152.000116:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5759f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129152.000131:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626555648 00000100:00100000:3.0:1789129152.000135:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626555648 00000100:00100000:3.0:1789129152.000164:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789129152.000172:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626555648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129152.000346:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626555648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129152.000354:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789129152.000393:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626555648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129152.000574:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11669:1876037626555776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129152.000632:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129152.000653:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626555776 00000100:00100000:3.0:1789129152.000657:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626555776 00000100:00100000:3.0:1789129152.000679:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789129152.000685:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:11669:x1876037626555776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129152.000812:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:11669:x1876037626555776:12345-0@lo:502:llog_process_th.0 Request processed in 127us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129152.000819:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789129152.000850:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b57599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129152.000863:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11669:1876037626555776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789129152.000882:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789129152.000892:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129152.000894:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789129152.000902:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b4921dd800 00000020:00000080:3.0:1789129152.000904:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789129152.000974:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11669:1876037626555904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129152.001017:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129152.001037:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626555904 00000100:00100000:3.0:1789129152.001041:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626555904 00000100:00100000:3.0:1789129152.001061:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789129152.001079:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:11669:x1876037626555904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129152.001184:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:11669:x1876037626555904:12345-0@lo:502:llog_process_th.0 Request processed in 117us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129152.001191:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789129152.001218:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b57599c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129152.001231:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902303c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:11669:1876037626555904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789129152.001249:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129152.001253:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129152.001254:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789129152.001258:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789129152.001314:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789129152.001331:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789129152.001342:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129152.001353:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129152.475481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129152.475581:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604493056 00000100:00100000:3.0:1789129152.475592:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604493056 00000100:00100000:3.0:1789129152.475694:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 275 00000100:00100000:3.0:1789129152.475705:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+11:5613:x1876037604493056:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129152.475721:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129152.475755:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce43cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa843 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129152.475784:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce43cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa843 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129152.475795:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce43cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa843 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129152.475805:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3800, rc 0) 00000100:00100000:3.0:1789129152.475879:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604493056:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 176us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129152.475886:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 275 00000100:00100000:3.0:1789129152.482521:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129152.483187:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604493184 00000100:00100000:2.0:1789129152.483205:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604493184 00000100:00100000:2.0:1789129152.483283:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 276 00000100:00100000:2.0:1789129152.483293:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604493184:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129152.483842:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604493184:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 547us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129152.483851:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 276 00000100:00100000:1.0:1789129152.491767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129152.491910:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604493312 00000100:00100000:0.0:1789129152.491925:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604493312 00000100:00100000:0.0:1789129152.492003:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 277 00000100:00100000:0.0:1789129152.492023:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604493312:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129152.492359:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604493312:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 339us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129152.492378:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 277 00000100:00100000:1.0:1789129152.508115:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129152.508361:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604493440 00000100:00100000:2.0:1789129152.508373:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604493440 00000100:00100000:2.0:1789129152.508435:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 278 00000100:00100000:2.0:1789129152.508463:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+12:9532:x1876037604493440:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789129152.508785:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+12:9532:x1876037604493440:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 323us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129152.508794:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 278 00000100:00100000:1.0:1789129152.519487:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129152.525272:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604493568 00000100:00100000:3.0:1789129152.525294:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604493568 00000100:00100000:3.0:1789129152.525368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 279 00000100:00100000:3.0:1789129152.525379:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+12:9532:x1876037604493568:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789129152.528364:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+12:9532:x1876037604493568:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 2974us (8881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129152.528380:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 279 00000100:00100000:3.0:1789129152.550107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129152.550905:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604493696 00000100:00100000:0.0:1789129152.550925:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604493696 00000100:00100000:0.0:1789129152.550995:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 280 00000100:00100000:0.0:1789129152.551006:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604493696:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789129152.551039:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129152.551071:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4829d5c00/0x5c74554e47ce43d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa84a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129152.551113:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4829d5c00/0x5c74554e47ce43d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa84a expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129152.551125:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4829d5c00/0x5c74554e47ce43d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa84a expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129152.551138:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d5c00, rc 0) 00000100:00100000:0.0:1789129152.551221:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604493696:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 216us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129152.551228:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 280 00000100:00100000:1.0:1789129152.572726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129152.572934:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604493824 00000100:00100000:2.0:1789129152.572944:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604493824 00000100:00100000:2.0:1789129152.572993:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 281 00000100:00100000:2.0:1789129152.573002:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604493824:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129152.573314:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604493824:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 310us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129152.573324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 281 00000100:00100000:1.0:1789129152.598277:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129152.598395:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604493952 00000100:00100000:3.0:1789129152.598405:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604493952 00000100:00100000:3.0:1789129152.598474:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 282 00000100:00100000:3.0:1789129152.598486:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604493952:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129152.598774:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604493952:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 288us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129152.598789:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 282 00000100:00100000:3.0:1789129152.606163:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129152.606525:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604494080 00000100:00100000:0.0:1789129152.606537:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604494080 00000100:00100000:0.0:1789129152.606592:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 283 00000100:00100000:0.0:1789129152.606650:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:9535:x1876037604494080:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789129152.606918:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:9535:x1876037604494080:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 316us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129152.606926:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 283 00000100:00100000:1.0:1789129152.619281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129152.619859:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604494208 00000100:00100000:2.0:1789129152.619871:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604494208 00000100:00100000:2.0:1789129152.619942:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 284 00000100:00100000:2.0:1789129152.619953:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:9535:x1876037604494208:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789129152.620276:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:9535:x1876037604494208:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 324us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129152.620285:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 284 00010000:00010000:2.0:1789129152.709976:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129153.567443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129153.567525:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604494336 00000100:00100000:2.0:1789129153.567542:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604494336 00000100:00100000:2.0:1789129153.567670:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:2.0:1789129153.567683:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604494336:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129153.567791:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604494336:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 110us (373us total) trans 0 rc 0/0 00000100:00080000:3.0:1789129153.567811:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129153.567821:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:3.0:1789129153.570662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129153.570707:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604494464 00000100:00100000:2.0:1789129153.570718:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604494464 00000100:00100000:2.0:1789129153.570807:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:2.0:1789129153.570818:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490230f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604494464:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129153.570898:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490230f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604494464:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 81us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129153.570906:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00080000:3.0:1789129153.571027:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789129153.733785:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129154.758393:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129154.822189:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789129154.822217:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490233840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626556032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129154.822298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129154.823335:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626556032 00000100:00100000:3.0:1789129154.823347:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626556032 00000100:00100000:3.0:1789129154.823416:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789129154.823428:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626556032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129154.823465:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129154.823538:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626556032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129154.823546:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789129154.823679:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129154.824481:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b490233840 x1876037626556032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129154.824512:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490233840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626556032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789129155.790747:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129156.357979:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626556160:0@lo:400:kworker.0 00000100:00100000:0.0:1789129156.358088:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129156.358163:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626556672:0@lo:400:kworker.0 00000100:00100000:0.0:1789129156.358191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129156.358219:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789129156.358226:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626556288:0@lo:400:kworker.0 00000100:00100000:0.0:1789129156.358249:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129156.358265:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626556800:0@lo:400:kworker.0 00000100:00100000:0.0:1789129156.358291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129156.358320:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626556672 00000100:00100000:0.0:1789129156.358327:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626556672 00000100:00100000:0.0:1789129156.358380:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626556288 00000100:00100000:0.0:1789129156.358384:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626556288 00000100:00100000:0.0:1789129156.358404:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789129156.358413:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626556672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129156.358467:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626556672:12345-0@lo:400:kworker.0 Request processed in 54us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129156.358475:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789129156.358490:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789129156.358497:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626556288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129156.358525:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626556288:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129156.358531:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1789129156.358551:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129156.358592:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626556288:0@lo:400:kworker.0 00000100:00100000:0.0:1789129156.358663:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626556672:0@lo:400:kworker.0 00000100:00100000:3.0:1789129156.358823:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626556416:0@lo:400:kworker.0 00000100:00100000:3.0:1789129156.358857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129156.358890:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129156.358897:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626556544:0@lo:400:kworker.0 00000100:00100000:3.0:1789129156.358920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129156.359002:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626556160 00000100:00100000:1.0:1789129156.359007:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626556160 00000100:00100000:1.0:1789129156.359047:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789129156.359053:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626556160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129156.359101:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626556160:12345-0@lo:400:kworker.0 Request processed in 48us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129156.359107:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789129156.359314:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626556800 00000100:00100000:2.0:1789129156.359320:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626556800 00000100:00100000:2.0:1789129156.359353:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626556544 00000100:00100000:2.0:1789129156.359357:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626556544 00000100:00100000:2.0:1789129156.359372:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789129156.359379:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626556800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129156.359417:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626556800:12345-0@lo:400:kworker.0 Request processed in 39us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129156.359423:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789129156.359435:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789129156.359440:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490233840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626556544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129156.359468:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490233840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626556544:12345-0@lo:400:kworker.0 Request processed in 28us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129156.359473:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1789129156.359505:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a79fa580 x1876037626556544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129156.359517:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626556544:0@lo:400:kworker.0 00000100:00100000:0.0:1789129156.359685:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626556416 00000100:00100000:0.0:1789129156.359690:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626556416 00000100:00100000:0.0:1789129156.359724:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789129156.359731:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490230b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626556416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129156.359763:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490230b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626556416:12345-0@lo:400:kworker.0 Request processed in 32us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129156.359768:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:0.0:1789129156.359796:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4a79fa940 x1876037626556800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129156.359807:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626556800:0@lo:400:kworker.0 00000100:00100000:0.0:1789129156.359817:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626556160:0@lo:400:kworker.0 00000100:00080000:1.0:1789129156.361395:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789129156.361409:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789129156.361412:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789129156.361478:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789129156.361502:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490233c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626556928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129156.361579:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129156.361719:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626556416:0@lo:400:kworker.0 00000100:00100000:3.0:1789129156.361823:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626556928 00000100:00100000:3.0:1789129156.361831:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626556928 00000100:00100000:3.0:1789129156.361896:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789129156.361906:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626556928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789129156.361959:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129156.362021:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626556928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129156.362043:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789129156.362909:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b490233c00 x1876037626556928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129156.362938:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490233c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626556928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789129156.805784:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129157.830735:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789129158.108277:0:11805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:19:15 (1789129155) === 00000100:00100000:2.0:1789129158.684586:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129158.684761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129158.684902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129158.684978:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604494592 00000100:00100000:0.0:1789129158.684989:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604494592 00000100:00100000:0.0:1789129158.685049:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 286 00000100:00100000:0.0:1789129158.685059:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604494592:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129158.685136:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604494592:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 79us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129158.685144:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 286 00000100:00100000:1.0:1789129158.692121:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604494848 00000100:00100000:1.0:1789129158.692141:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604494848 00000100:00100000:1.0:1789129158.692240:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604494720 00000100:00100000:1.0:1789129158.692244:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604494720 00000100:00100000:1.0:1789129158.692284:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:1.0:1789129158.692295:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604494848:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129158.692392:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604494848:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 100us (7631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129158.692510:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:3.0:1789129158.692521:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604494720:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129158.692548:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604494720:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 31us (7647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129158.692555:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:1.0:1789129158.693294:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00080000:2.0:1789129158.693413:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789129158.855006:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129159.878721:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129159.943208:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490233c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626557056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129159.943302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129159.943483:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626557056 00000100:00100000:3.0:1789129159.943494:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626557056 00000100:00100000:3.0:1789129159.943581:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789129159.943596:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626557056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129159.943664:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129159.943723:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626557056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129159.943732:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1789129159.943792:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b490233c00 x1876037626557056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129175 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789129159.943804:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129159.943819:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490233c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626557056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129160.353378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129160.353540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.353698:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604494976 00000100:00100000:1.0:1789129160.353715:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604494976 00000100:00100000:1.0:1789129160.353836:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789129160.353853:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490233c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604494976:12345-192.168.201.39@tcp:41:mkdir.0 00000004:00000024:1.0:1789129160.353944:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789129160.354105:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490233c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604494976:12345-192.168.201.39@tcp:41:mkdir.0 Request processed in 257us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129160.354115:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789129160.354160:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604495104 00000100:00100000:1.0:1789129160.354164:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604495104 00000100:00100000:1.0:1789129160.354197:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1789129160.354223:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:9902:x1876037604495104:12345-192.168.201.39@tcp:700:mkdir.0 00000100:00100000:1.0:1789129160.354273:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:9902:x1876037604495104:12345-192.168.201.39@tcp:700:mkdir.0 Request processed in 53us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129160.354281:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00080000:3.0:1789129160.354586:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129160.361206:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.361297:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604495360 00000100:00100000:1.0:1789129160.361313:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604495360 00000100:00100000:1.0:1789129160.361417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:1.0:1789129160.361432:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:9902:x1876037604495360:12345-192.168.201.39@tcp:36:mkdir.0 00010000:00010000:1.0:1789129160.361548:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129160.363380:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce427c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7be expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.363432:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b000) 00010000:00010000:1.0:1789129160.363467:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129160.364513:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce43da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.364532:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce43da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.364544:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce43da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.364584:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.364591:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.364778:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129160.370221:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789129160.370263:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce43da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.370278:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce43da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.370287:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce43da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.370296:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129160.370303:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce43da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.370316:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce43da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.370343:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117bf00) 00010000:00010000:1.0:1789129160.370348:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129160.370354:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce43da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.370363:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce43da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789129160.370421:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ae65ca59 reply state 00000000e8b7a2f6 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129160.370454:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789129160.372331:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:9902:x1876037604495360:12345-192.168.201.39@tcp:36:mkdir.0 Request processed in 10883us (11126us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789129160.372351:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00010000:00010000:2.0:1789129160.387076:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.387111:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.387121:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.387128:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129160.387134:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.387143:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.387166:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90b49117ba00) 00010000:00010000:2.0:1789129160.387183:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129160.387189:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.387197:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce43e1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129160.398789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.398881:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604495488 00000100:00100000:1.0:1789129160.398903:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604495488 00000100:00100000:1.0:1789129160.398996:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789129160.399009:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:9903:x1876037604495488:12345-192.168.201.39@tcp:101:chmod.0 00010000:00010000:1.0:1789129160.399041:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129160.399078:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce43e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa851 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.399175:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce43ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.399193:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce43ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.399206:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce43ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129160.399299:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789129160.399304:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129160.399376:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce43ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.399406:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce43e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa851 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.399453:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce43ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa851 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.399463:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117bd00) 00010000:00010000:1.0:1789129160.399467:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789129160.399472:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656200, rc 0) 00000100:00100000:1.0:1789129160.399564:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:9903:x1876037604495488:12345-192.168.201.39@tcp:101:chmod.0 Request processed in 557us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129160.399573:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789129160.406627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129160.406962:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604495744 00000100:00100000:0.0:1789129160.406983:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604495744 00000100:00100000:0.0:1789129160.407312:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789129160.407326:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:9903:x1876037604495744:12345-192.168.201.39@tcp:36:chmod.0 00010000:00010000:0.0:1789129160.407432:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129160.407474:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce43ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa851 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.407510:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117bd00) 00010000:00010000:0.0:1789129160.407527:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129160.407584:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.407629:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.407644:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129160.408163:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000fa27512 reply state 00000000635e82df transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129160.408177:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789129160.408197:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1789129160.408358:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:9903:x1876037604495744:12345-192.168.201.39@tcp:36:chmod.0 Request processed in 1033us (1766us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789129160.408368:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00010000:00010000:1.0:1789129160.421025:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.421048:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.421056:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.421063:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129160.421068:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.421076:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.421095:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789129160.421098:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789129160.421110:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.421118:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43f6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129160.473408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129160.473487:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604495872 00000100:00100000:0.0:1789129160.473501:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604495872 00000100:00100000:0.0:1789129160.473572:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1789129160.473585:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:9904:x1876037604495872:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:0.0:1789129160.473653:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129160.473693:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa858 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.474030:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce4404 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.474049:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce4404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.474144:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce4404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129160.474223:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789129160.474228:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789129160.474274:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce4404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.474300:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce43fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa858 expref: 9 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.474319:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce4404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa858 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.474328:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8200) 00010000:00010000:0.0:1789129160.474331:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789129160.474342:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4829d4c00, rc 0) 00000100:00100000:0.0:1789129160.474419:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:9904:x1876037604495872:12345-192.168.201.39@tcp:101:chown.0 Request processed in 837us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129160.474427:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1789129160.489781:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.490312:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604496000 00000100:00100000:1.0:1789129160.490323:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604496000 00000100:00100000:1.0:1789129160.490389:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789129160.490401:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:9904:x1876037604496000:12345-192.168.201.39@tcp:101:chown.0 00010000:00010000:1.0:1789129160.490427:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129160.490455:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce440b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa85f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.490544:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4412 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.490563:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.490578:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.490594:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4419 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.490620:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.490627:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.490986:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.490996:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491003:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129160.491258:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789129160.491263:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129160.491302:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491317:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4412 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491323:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4412 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491330:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4412 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491337:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481657200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129160.491342:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4412 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491351:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4412 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491364:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8200) 00010000:00010000:1.0:1789129160.491375:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129160.491382:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491389:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491413:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4419 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491419:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4419 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491425:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4419 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491430:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481657600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129160.491433:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4419 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491439:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4419 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491447:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90b49117bf00) 00010000:00010000:1.0:1789129160.491449:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129160.491452:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4419 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491457:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4419 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491497:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce440b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa85f expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491529:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa85f expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.491537:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117b000) 00010000:00010000:1.0:1789129160.491540:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789129160.491542:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656200, rc 0) 00000100:00100000:1.0:1789129160.493110:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:9904:x1876037604496000:12345-192.168.201.39@tcp:101:chown.0 Request processed in 2643us (3274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129160.493124:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789129160.500121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.500254:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604496256 00000100:00100000:1.0:1789129160.500265:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604496256 00000100:00100000:1.0:1789129160.500329:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1789129160.500341:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:9904:x1876037604496256:12345-192.168.201.39@tcp:36:chown.0 00010000:00010000:1.0:1789129160.500415:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129160.500449:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa85f expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.500475:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117b000) 00010000:00010000:1.0:1789129160.500490:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129160.500522:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.500535:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.500546:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789129160.539156:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000004:00010000:1.0:1789129160.539297:0:6710:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000deef635a reply state 000000004f03588e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129160.539315:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789129160.539532:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1789129160.539685:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:9904:x1876037604496256:12345-192.168.201.39@tcp:36:chown.0 Request processed in 39340us (39567us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789129160.540405:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000001:00080000:2.0:1789129160.542527:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1789129160.542721:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.542739:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.542749:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.542756:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129160.542957:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.542969:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.542994:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117b600) 00010000:00010000:3.0:1789129160.542997:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789129160.543004:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.543011:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656800/0x5c74554e47ce4427 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129160.563398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129160.563503:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604496384 00000100:00100000:3.0:1789129160.563514:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604496384 00000100:00100000:3.0:1789129160.563583:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1789129160.563593:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:9905:x1876037604496384:12345-192.168.201.39@tcp:101:touch.500 00010000:00010000:3.0:1789129160.563652:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129160.563677:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce442e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa866 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789129160.571501:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7752us 00010000:00010000:1.0:1789129160.597809:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4435 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.597837:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4435 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.597851:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4435 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.597951:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce443c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.597960:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce443c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.597967:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce443c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.598422:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.598441:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.598449:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129160.598524:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789129160.598529:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129160.599067:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599082:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4435 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599089:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4435 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599095:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4435 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599101:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129160.599105:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4435 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599113:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4435 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599127:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8200) 00010000:00010000:1.0:1789129160.599131:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129160.599136:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599152:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599175:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce443c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599181:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce443c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599188:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce443c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599192:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129160.599195:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce443c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599202:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce443c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599210:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90b49117b000) 00010000:00010000:1.0:1789129160.599213:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129160.599216:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce443c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599222:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce443c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599265:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce442e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa866 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599279:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa866 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.599292:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117bf00) 00010000:00010000:1.0:1789129160.599295:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789129160.599297:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657600, rc 0) 00000100:00100000:1.0:1789129160.599430:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:9905:x1876037604496384:12345-192.168.201.39@tcp:101:touch.500 Request processed in 35837us (36043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129160.599441:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1789129160.605130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129160.605219:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604496640 00000100:00100000:0.0:1789129160.605234:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604496640 00000100:00100000:0.0:1789129160.605348:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789129160.605361:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:9905:x1876037604496640:12345-192.168.201.39@tcp:101:touch.500 00010000:00010000:0.0:1789129160.605394:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129160.605426:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5800/0x5c74554e47ce444a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa86d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.606513:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce4451 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.606536:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce4451 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.606552:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce4451 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.606768:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.606777:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.606785:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789129160.609833:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1789129160.610367:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce445f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.610387:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce445f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.610401:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce445f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.610448:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce4451 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.610456:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce4451 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.610462:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce4451 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.610467:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129160.610471:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce4451 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.610480:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce4451 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.610494:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117bf00) 00010000:00010000:0.0:1789129160.610497:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129160.610503:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce4451 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.610519:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5e00/0x5c74554e47ce4451 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129160.610535:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008e2f18df reply state 000000008e5a49ab transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129160.610545:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789129160.610589:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d5800/0x5c74554e47ce444a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa86d expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.611093:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce445f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa86d expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.611103:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789129160.611105:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129160.611107:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:0.0:1789129160.611199:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:9905:x1876037604496640:12345-192.168.201.39@tcp:101:touch.500 Request processed in 5840us (6080us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789129160.611209:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00010000:00010000:3.0:1789129160.615042:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.615070:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.615078:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.615106:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d4600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129160.615113:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.615122:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.615141:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff90b4976b8500) 00010000:00010000:3.0:1789129160.615144:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129160.615150:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.615156:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4600/0x5c74554e47ce4458 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129160.618200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129160.618443:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604496896 00000100:00100000:0.0:1789129160.618454:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604496896 00000100:00100000:0.0:1789129160.618519:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1789129160.618532:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:9905:x1876037604496896:12345-192.168.201.39@tcp:36:touch.500 00010000:00010000:0.0:1789129160.618636:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129160.618670:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce445f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa86d expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.618951:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789129160.618963:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129160.619021:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.619036:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.619046:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129160.619204:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002735fa4f reply state 000000003a4b63f4 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129160.619213:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789129160.619307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:9905:x1876037604496896:12345-192.168.201.39@tcp:36:touch.500 Request processed in 778us (1119us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789129160.619314:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00010000:00010000:3.0:1789129160.622823:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.622845:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.622854:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.622860:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129160.622981:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.622992:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.623032:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:3.0:1789129160.623035:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129160.623042:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.623048:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce446d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129160.627473:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129160.628059:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604497024 00000100:00100000:0.0:1789129160.628073:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604497024 00000100:00100000:0.0:1789129160.628141:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:0.0:1789129160.628153:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:9905:x1876037604497024:12345-192.168.201.39@tcp:101:touch.500 00010000:00010000:0.0:1789129160.628180:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129160.628208:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa874 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.628272:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa874 expref: 10 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.628306:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa874 expref: 10 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.628328:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789129160.628331:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129160.628336:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:0.0:1789129160.628527:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:9905:x1876037604497024:12345-192.168.201.39@tcp:101:touch.500 Request processed in 375us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129160.628535:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:0.0:1789129160.633290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129160.633399:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604497152 00000100:00100000:2.0:1789129160.633416:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604497152 00000100:00100000:2.0:1789129160.633492:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789129160.633503:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2366:x1876037604497152:12345-192.168.201.39@tcp:8:touch.500 00010000:00080000:2.0:1789129160.633889:0:6689:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1789129160.633941:0:6689:0:(genops.c:1385:class_connect()) connect: client 9463e625-4f12-4089-85aa-d90aafb8e5a9, cookie 0x5c74554e47ce447b 00002000:00100000:2.0:1789129160.633958:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9463e625-4f12-4089-85aa-d90aafb8e5a9/ffff90b485cb1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789129160.633993:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1789129160.634307:0:6689:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789129160.634346:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90b485cb2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789129160.634446:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2366:x1876037604497152:12345-192.168.201.39@tcp:8:touch.500 Request processed in 942us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129160.634456:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789129160.637863:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129160.638197:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604497280 00000100:00100000:3.0:1789129160.638209:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604497280 00000100:00100000:3.0:1789129160.638333:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1789129160.638348:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:0:x1876037604497280:12345-192.168.201.39@tcp:2:touch.500 00000100:00080000:2.0:1789129160.644538:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789129160.680721:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:0:x1876037604497280:12345-192.168.201.39@tcp:2:touch.500 Request processed in 42344us (42842us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789129160.680740:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000001:00100000:1.0:1789129160.682243:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00000001:00080000:1.0:1789129160.682266:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1789129160.684019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.684382:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604497536 00000100:00100000:1.0:1789129160.684395:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604497536 00000100:00100000:1.0:1789129160.684463:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1789129160.684475:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:9905:x1876037604497536:12345-192.168.201.39@tcp:35:touch.500 00000100:00100000:1.0:1789129160.685118:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+11:9905:x1876037604497536:12345-192.168.201.39@tcp:35:touch.500 Request processed in 642us (1105us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789129160.685128:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:3.0:1789129160.704093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.704407:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604497664 00000100:00100000:1.0:1789129160.704418:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604497664 00000100:00100000:1.0:1789129160.704491:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1789129160.704502:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+11:9906:x1876037604497664:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:1.0:1789129160.704533:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129160.704559:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce4482 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa87b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.704734:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.704761:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.704775:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129160.704872:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789129160.704877:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129160.704938:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.704972:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce4482 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa87b expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.705000:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa87b expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.705009:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117bf00) 00010000:00010000:1.0:1789129160.705012:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789129160.705017:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656200, rc 0) 00000100:00100000:1.0:1789129160.705097:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:9906:x1876037604497664:12345-192.168.201.39@tcp:101:rm.0 Request processed in 597us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129160.705105:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:2.0:1789129160.712767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.713369:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604497920 00000100:00100000:1.0:1789129160.713382:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604497920 00000100:00100000:1.0:1789129160.713471:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:1.0:1789129160.713484:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:9906:x1876037604497920:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:1.0:1789129160.713510:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129160.713534:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce4490 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa882 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129160.713711:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789129160.714141:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce4490 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa882 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.714162:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8200) 00010000:00010000:1.0:1789129160.714166:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789129160.714172:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce4490 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa882 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.714199:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656a00, rc 0) 00000100:00100000:1.0:1789129160.714399:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:9906:x1876037604497920:12345-192.168.201.39@tcp:101:rm.0 Request processed in 917us (1644us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1789129160.714407:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:3.0:1789129160.726138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.726313:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604498048 00000100:00100000:1.0:1789129160.726325:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604498048 00000100:00100000:1.0:1789129160.726396:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:1.0:1789129160.726409:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:9906:x1876037604498048:12345-192.168.201.39@tcp:37:rm.0 00000100:00100000:1.0:1789129160.733480:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:9906:x1876037604498048:12345-192.168.201.39@tcp:37:rm.0 Request processed in 7063us (7343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129160.733495:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:3.0:1789129160.738035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129160.738214:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604498304 00000100:00100000:0.0:1789129160.738224:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604498304 00000100:00100000:0.0:1789129160.738284:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:0.0:1789129160.738295:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:9906:x1876037604498304:12345-192.168.201.39@tcp:35:rm.0 00000100:00100000:0.0:1789129160.739050:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:9906:x1876037604498304:12345-192.168.201.39@tcp:35:rm.0 Request processed in 754us (1024us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789129160.739060:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1789129160.742816:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.743056:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604498560 00000100:00100000:1.0:1789129160.743086:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604498560 00000100:00100000:1.0:1789129160.743170:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:1.0:1789129160.743184:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:9906:x1876037604498560:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:1.0:1789129160.743213:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129160.743242:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce449e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa889 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.743377:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce44a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.743394:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce44a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.743406:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce44a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129160.743420:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789129160.743578:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce449e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa889 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.743667:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce44a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa889 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.743677:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117bf00) 00010000:00010000:1.0:1789129160.743680:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789129160.743685:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657200, rc 0) 00000100:00100000:1.0:1789129160.744321:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:9906:x1876037604498560:12345-192.168.201.39@tcp:101:rm.0 Request processed in 1135us (1509us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789129160.744332:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:3.0:1789129160.749558:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129160.750666:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604498688 00000100:00100000:0.0:1789129160.750687:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604498688 00000100:00100000:0.0:1789129160.751072:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:0.0:1789129160.751086:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:9906:x1876037604498688:12345-192.168.201.39@tcp:41:rm.0 00000004:00000024:0.0:1789129160.751170:0:6710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789129160.751271:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:9906:x1876037604498688:12345-192.168.201.39@tcp:41:rm.0 Request processed in 188us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129160.751281:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789129160.754558:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.755320:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604498816 00000100:00100000:1.0:1789129160.755334:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604498816 00000100:00100000:1.0:1789129160.755428:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1789129160.755440:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:9906:x1876037604498816:12345-192.168.201.39@tcp:101:rm.0 00010000:00010000:1.0:1789129160.755472:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129160.755506:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce44b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa890 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756061:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756083:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756098:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756116:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756124:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756131:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756254:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47ce44c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756263:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47ce44c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756288:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47ce44c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129160.756317:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789129160.756322:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129160.756339:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47ce44c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756351:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47ce44c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756360:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756368:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756374:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756380:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129160.756384:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756391:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756403:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117bf00) 00010000:00010000:1.0:1789129160.756405:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129160.756411:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756425:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756445:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756451:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756457:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756462:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129160.756464:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756470:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756477:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff90b49117b000) 00010000:00010000:1.0:1789129160.756479:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129160.756481:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756486:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756515:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656a00/0x5c74554e47ce44b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa890 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756526:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47ce44c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa890 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.756538:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789129160.757272:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789129160.757276:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656600, rc 0) 00000100:00100000:1.0:1789129160.757366:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:9906:x1876037604498816:12345-192.168.201.39@tcp:101:rm.0 Request processed in 1924us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129160.757376:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:1.0:1789129160.762508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129160.763080:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604499072 00000100:00100000:2.0:1789129160.763095:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604499072 00000100:00100000:2.0:1789129160.763196:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789129160.763209:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:9906:x1876037604499072:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:2.0:1789129160.763290:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789129160.763327:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656600/0x5c74554e47ce44c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa890 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.763364:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa874 expref: 16 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.763377:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789129160.763396:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa87b expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.763407:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117bf00) 00010000:00010000:2.0:1789129160.763411:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789129160.763443:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce44cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.763458:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce44cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.763469:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce44cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.763488:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.763516:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.763524:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.764370:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce44dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.764380:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce44dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.764388:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce44dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129160.766253:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789129160.766275:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323863671761ns, next at 324863667666ns, rc = 0 00010000:00010000:2.0:1789129160.766375:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766392:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766403:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766414:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766421:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766444:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766470:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789129160.766506:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce44dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766513:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce44dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766520:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce44dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766527:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ba00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129160.766533:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce44dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766554:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce44dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766569:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90b48544d100) 00010000:00010000:2.0:1789129160.766573:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789129160.766580:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce44dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766587:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ba00/0x5c74554e47ce44dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766652:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce44cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766659:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce44cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766671:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce44cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766676:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129160.766679:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce44cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.766685:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce44cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.767062:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129160.767073:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.767079:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129160.767083:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.767090:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.767102:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90b48544d100) 00010000:00010000:0.0:1789129160.767104:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789129160.767108:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.767114:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce44e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129160.767144:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129160.767146:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129160.767147:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129160.767281:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117bf00) 00010000:00010000:2.0:1789129160.767283:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129160.767287:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce44cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.767293:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b000/0x5c74554e47ce44cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789129160.767308:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d66d7066 reply state 00000000d5b94255 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129160.767318:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129160.767465:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:9906:x1876037604499072:12345-192.168.201.39@tcp:36:rm.0 Request processed in 4255us (4970us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789129160.767475:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:1.0:1789129160.773362:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789129160.774243:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.774260:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.774268:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.774274:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129160.774279:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.774305:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.774324:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff90b48544d000) 00010000:00010000:3.0:1789129160.774329:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129160.774335:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.774343:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce44d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129160.775153:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604499328 00000100:00100000:0.0:1789129160.775168:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604499328 00000100:00100000:0.0:1789129160.775272:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:0.0:1789129160.775283:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:9906:x1876037604499328:12345-192.168.201.39@tcp:35:rm.0 00000100:00100000:0.0:1789129160.775630:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:9906:x1876037604499328:12345-192.168.201.39@tcp:35:rm.0 Request processed in 321us (2257us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789129160.775639:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1789129160.781380:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129160.781650:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604499584 00000100:00100000:1.0:1789129160.781666:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604499584 00000100:00100000:1.0:1789129160.781777:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:1.0:1789129160.781801:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:9906:x1876037604499584:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:1.0:1789129160.782236:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789129160.782275:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce44a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa889 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.782313:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce4443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa866 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.782328:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117bf00) 00010000:00010000:1.0:1789129160.782345:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4829d4c00/0x5c74554e47ce4404 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa858 expref: 14 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.782355:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8200) 00010000:00010000:1.0:1789129160.782362:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129160.782405:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44eb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.782421:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.782432:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.782445:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.782452:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.782458:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.783229:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce44f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.783244:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce44f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.783255:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce44f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129160.785471:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789129160.785505:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce44f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.785516:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce44f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.785536:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce44f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786252:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129160.786257:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce44f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786265:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce44f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786282:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90b49117b600) 00010000:00010000:1.0:1789129160.786285:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789129160.786291:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce44f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786298:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce44f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786337:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786343:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44eb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786350:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786355:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129160.786358:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786382:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786390:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b000) 00010000:00010000:1.0:1789129160.786393:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129160.786396:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129160.786403:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce44eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789129160.786418:0:6710:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000092106b02 reply state 0000000052a7eca1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129160.786429:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789129160.787149:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:9906:x1876037604499584:12345-192.168.201.39@tcp:36:rm.0 Request processed in 5353us (5781us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789129160.787161:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00010000:00010000:2.0:1789129160.792735:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.792772:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.792811:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.792818:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129160.792824:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.792833:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.792854:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff90b49117bb00) 00010000:00010000:2.0:1789129160.792858:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129160.792874:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129160.792882:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce44f2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129160.903115:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129161.480335:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626557440:0@lo:400:kworker.0 00000100:00100000:0.0:1789129161.480362:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626557568:0@lo:400:kworker.0 00000100:00100000:2.0:1789129161.480442:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626557312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129161.480506:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626557184:0@lo:400:kworker.0 00000100:00100000:1.0:1789129161.484738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129161.484972:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626557696:0@lo:400:kworker.0 00000100:00100000:1.0:1789129161.485009:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129161.485179:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626557696 00000100:00100000:1.0:1789129161.485187:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626557696 00000100:00100000:1.0:1789129161.485245:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789129161.485254:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626557696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129161.485310:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626557696:12345-0@lo:400:kworker.0 Request processed in 56us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129161.485337:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789129161.485360:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129161.485391:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bac85e00 x1876037626557696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129161.485406:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626557696:0@lo:400:kworker.0 00000100:00100000:1.0:1789129161.485461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626557184 00000100:00100000:1.0:1789129161.485465:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626557184 00000100:00100000:1.0:1789129161.485492:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789129161.485499:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626557184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129161.485536:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626557184:12345-0@lo:400:kworker.0 Request processed in 37us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129161.485542:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789129161.485577:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626557184:0@lo:400:kworker.0 00000100:00100000:0.0:1789129161.486155:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129161.486237:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789129161.486247:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626557952:0@lo:400:kworker.0 00000100:00100000:0.0:1789129161.486285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129161.486322:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626557952 00000100:00100000:0.0:1789129161.486327:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626557952 00000100:00100000:0.0:1789129161.486370:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789129161.486378:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626557952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129161.486421:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626557952:12345-0@lo:400:kworker.0 Request processed in 43us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129161.486428:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789129161.486448:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789129161.486480:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bac84f00 x1876037626557952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129161.486491:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626557952:0@lo:400:kworker.0 00000100:00100000:1.0:1789129161.486548:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626557568 00000100:00100000:1.0:1789129161.486553:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626557568 00000100:00100000:1.0:1789129161.486652:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789129161.486660:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626557568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129161.486676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129161.486707:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626557440 00000100:00100000:3.0:1789129161.486711:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626557440 00000100:00100000:3.0:1789129161.486737:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789129161.486744:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626557440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129161.486779:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626557568:12345-0@lo:400:kworker.0 Request processed in 120us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129161.486792:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626557440:12345-0@lo:400:kworker.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129161.486798:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789129161.486826:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626557440:0@lo:400:kworker.0 00000100:00100000:1.0:1789129161.486920:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1789129161.486963:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129161.486986:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626557568:0@lo:400:kworker.0 00000100:00100000:2.0:1789129161.486991:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129161.501557:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626557824:0@lo:400:kworker.0 00000100:00100000:2.0:1789129161.501648:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129161.501994:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626557312 00000100:00100000:1.0:1789129161.502004:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626557312 00000100:00100000:1.0:1789129161.502093:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789129161.502103:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626557312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129161.502131:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129161.502198:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626557312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (15205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129161.502205:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1789129161.502434:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4b5b95680 x1876037626557312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129161.502455:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626557312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129161.502575:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626557824 00000100:00100000:3.0:1789129161.502580:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626557824 00000100:00100000:3.0:1789129161.502667:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789129161.502685:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626557824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129161.502743:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626557824:12345-0@lo:400:kworker.0 Request processed in 69us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129161.502758:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789129161.502892:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626557824:0@lo:400:kworker.0 00000100:00080000:0.0:1789129161.502956:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789129161.927863:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129162.949892:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129163.803267:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129163.803308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129163.803362:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129163.803397:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129163.803439:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604499840 00000100:00100000:2.0:1789129163.803448:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604499840 00000100:00100000:2.0:1789129163.803508:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604500096 00000100:00100000:2.0:1789129163.803512:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604500096 00000100:00100000:2.0:1789129163.803538:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:2.0:1789129163.803549:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2370:x1876037604499840:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129163.803654:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2370:x1876037604499840:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 107us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129163.803662:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:2.0:1789129163.803684:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:2.0:1789129163.803690:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2370:x1876037604500096:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129163.803711:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2370:x1876037604500096:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 21us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129163.803717:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:0.0:1789129163.803919:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604499968 00000100:00100000:0.0:1789129163.803923:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604499968 00000100:00100000:0.0:1789129163.803960:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:0.0:1789129163.803976:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2370:x1876037604499968:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129163.804072:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2370:x1876037604499968:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129163.804081:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00080000:0.0:1789129163.804100:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789129163.804105:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129163.804414:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604499712 00000100:00100000:1.0:1789129163.804421:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604499712 00000100:00100000:1.0:1789129163.804469:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 288 00000100:00100000:1.0:1789129163.804476:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604499712:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129163.804527:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604499712:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 51us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129163.804534:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 288 00010000:00010000:2.0:1789129163.974362:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129164.997781:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129165.067324:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b49036a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626558080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129165.067476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129165.067628:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626558080 00000100:00100000:0.0:1789129165.067637:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626558080 00000100:00100000:0.0:1789129165.067714:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789129165.067725:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626558080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129165.067763:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129165.067823:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626558080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129165.067831:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1789129165.067901:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789129165.067959:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b49036a940 x1876037626558080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129165.067983:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b49036a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626558080:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789129165.514925:0:12003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1789129165.627970:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1789129165.628003:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1789129165.628019:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789129165.628275:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789129165.628298:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626558208:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789129165.628379:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129165.628491:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626558208 00000100:00100000:1.0:1789129165.628499:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626558208 00000100:00100000:1.0:1789129165.628566:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789129165.628579:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626558208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789129165.628645:0:6686:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1789129165.628688:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3f1c8, atime: 0x6aa3f1c8, ctime: 0x6aa3f1c8, blocks: 0x1 00010000:00010000:1.0:1789129165.628697:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8dd03ca/0x5c74554e47ce4500 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129165.628718:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:1.0:1789129165.628724:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129165.628732:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8dd03ca/0x5c74554e47ce4500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129165.628771:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8dd03ca/0x5c74554e47ce4500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129165.628795:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8dd03ca/0x5c74554e47ce4500 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129165.628803:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8dd03ca/0x5c74554e47ce4500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129165.628821:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789129165.629453:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626558208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 871us (1068us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789129165.629463:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789129165.629667:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789129165.629714:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4a79fa580/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789129165.629722:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626558208:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789129165.630892:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129165.630904:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8dd03ca/0x5c74554e47ce4500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129165.630918:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129165.630923:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8dd03ca/0x5c74554e47ce4500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129165.630937:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8dd03ca/0x5c74554e47ce4500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129165.630982:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8dd03ca/0x5c74554e47ce4500 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129165.630990:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8dd03ca/0x5c74554e47ce4500 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129165.631021:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129165.631023:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129165.631025:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129166.040688:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789129166.189081:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1789129166.598686:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626558336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129166.598986:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626558464:0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129166.599080:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626558976:0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129166.599133:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789129166.599140:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626558592:0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129166.599180:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626559104:0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129166.599251:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626558464 00000100:00100000:1.0:1789129166.599260:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626558464 00000100:00100000:1.0:1789129166.599310:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789129166.599320:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626558464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599373:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626558464:12345-0@lo:400:kworker.0 Request processed in 55us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129166.599381:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789129166.599411:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626558976 00000100:00100000:1.0:1789129166.599415:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626558976 00000100:00100000:1.0:1789129166.599450:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626558592 00000100:00100000:1.0:1789129166.599454:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626558592 00000100:00100000:1.0:1789129166.599474:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789129166.599480:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626558976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599513:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626558976:12345-0@lo:400:kworker.0 Request processed in 33us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129166.599520:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789129166.599532:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789129166.599538:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626558592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599564:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626558592:12345-0@lo:400:kworker.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129166.599571:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789129166.599592:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626559104 00000100:00100000:1.0:1789129166.599595:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626559104 00000100:00100000:1.0:1789129166.599641:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789129166.599647:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626559104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599675:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626559104:12345-0@lo:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129166.599691:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1789129166.599710:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129166.599748:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626558592:0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599770:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1789129166.599777:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4a79fa580, transno 4294967300 00000100:00100000:1.0:1789129166.599787:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626559104:0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599796:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626558464:0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.599804:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626558976:0@lo:400:kworker.0 00000100:00100000:2.0:1789129166.604258:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129166.604345:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626558848:0@lo:400:kworker.0 00000100:00100000:2.0:1789129166.604402:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129166.604426:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789129166.604432:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626558720:0@lo:400:kworker.0 00000100:00100000:2.0:1789129166.604470:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129166.604516:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626558848 00000100:00100000:2.0:1789129166.604527:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626558848 00000100:00100000:2.0:1789129166.604619:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789129166.604632:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626558848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129166.604700:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626558848:12345-0@lo:400:kworker.0 Request processed in 69us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129166.604708:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1789129166.604784:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902ff840 x1876037626558848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129166.604798:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626558848:0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.605070:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626558336 00000100:00100000:1.0:1789129166.605075:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626558336 00000100:00100000:1.0:1789129166.605115:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789129166.605123:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626558336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129166.605153:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129166.605194:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626558336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129166.605201:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789129166.605224:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626558720 00000100:00100000:1.0:1789129166.605228:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626558720 00000100:00100000:1.0:1789129166.605266:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789129166.605272:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626558720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.605303:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626558720:12345-0@lo:400:kworker.0 Request processed in 32us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129166.605309:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1789129166.605326:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129166.605354:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626558720:0@lo:400:kworker.0 00000100:00100000:1.0:1789129166.605371:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626558336:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1789129166.627275:0:12054:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9ac733e0 20000000:00000080:2.0:1789129166.627298:0:12054:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b4bad11800 uarg=0000000000000000 20000000:01000000:2.0:1789129166.627342:0:12054:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789129166.627349:0:12054:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789129166.627355:0:12054:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789129166.629972:0:12055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1789129166.630161:0:12054:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789129166.638467:0:12054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:1.0:1789129166.638550:0:12054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10256 00000040:00080000:1.0:1789129166.638590:0:12054:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10480 10000000:01000000:1.0:1789129166.638668:0:12054:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789129166.638695:0:12054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.638718:0:12054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce43a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce43a2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.638725:0:12054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4829d4a00/0x5c74554e47ce43b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce43b0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.638731:0:12054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b48151b400/0x5c74554e47ce43c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce43be expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.638741:0:12054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce43cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa843 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.638748:0:12054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4829d5c00/0x5c74554e47ce43d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa84a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.638757:0:12054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.638821:0:12054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4829d5c00/0x5c74554e47ce43d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa84a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.638853:0:12054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4829d5c00/0x5c74554e47ce43d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa84a expref: 12 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.638874:0:12054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12054:1876037626559232:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129166.638997:0:12054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce43cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa843 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.639006:0:12054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce43cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa843 expref: 12 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.639015:0:12054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fe1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12054:1876037626559360:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129166.639046:0:12054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b48151b400/0x5c74554e47ce43c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce43be expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.639054:0:12054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b48151b400/0x5c74554e47ce43c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce43be expref: 18 pid: 5835 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.639062:0:12054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fe580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12054:1876037626559488:0@lo:104: 00000100:00100000:1.0:1789129166.639108:0:12054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789129166.639148:0:12054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4829d4a00/0x5c74554e47ce43b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce43b0 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.639156:0:12054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b4829d4a00/0x5c74554e47ce43b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce43b0 expref: 18 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.639163:0:12054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12054:1876037626559616:0@lo:104: 00000100:00100000:1.0:1789129166.639183:0:12054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789129166.639224:0:12054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce43a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce43a2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.639231:0:12054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce43a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce43a2 expref: 18 pid: 5835 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.639239:0:12054:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12054:1876037626559744:0@lo:104: 00000100:00100000:1.0:1789129166.639259:0:12054:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129166.639269:0:12054:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911600 going to sleep for 11 seconds 00000100:00100000:3.0:1789129166.639359:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626559488 00000100:00100000:3.0:1789129166.639365:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626559488 00000100:00100000:3.0:1789129166.639393:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626559616 00000100:00100000:3.0:1789129166.639395:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626559616 00000100:00100000:3.0:1789129166.639400:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626559744 00000100:00100000:3.0:1789129166.639401:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626559744 00000100:00100000:3.0:1789129166.639410:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789129166.639415:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:12054:x1876037626559488:12345-0@lo:104: 00010000:00010000:3.0:1789129166.639426:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.639491:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789129166.639498:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+5:12054:x1876037626559488:12345-0@lo:104: Request processed in 82us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129166.639507:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789129166.639527:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789129166.639534:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:12054:x1876037626559616:12345-0@lo:104: 00010000:00010000:3.0:1789129166.639541:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.639580:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789129166.639592:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+4:12054:x1876037626559616:12345-0@lo:104: Request processed in 59us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129166.639598:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1789129166.639627:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789129166.639636:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1789129166.639637:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129166.639644:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:12054:x1876037626559744:12345-0@lo:104: 00010000:00010000:0.0:1789129166.639651:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc1c28c20) 00010000:00010000:3.0:1789129166.639656:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129166.639657:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.639687:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129166.639695:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.639702:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:0.0:1789129166.639702:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789129166.639710:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+3:12054:x1876037626559744:12345-0@lo:104: Request processed in 68us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129166.639716:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789129166.639734:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789129166.639740:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.639741:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.639756:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4829d5a00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789129166.639760:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.639769:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789129166.639788:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.639789:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1789129166.639797:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789129166.639827:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.639830:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.639848:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789129166.639849:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151ac00/0x5c74554e47ce43be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce43c5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.639857:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.639863:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4829d5a00/0x5c74554e47ce43b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce43b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.639867:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129166.639872:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.639876:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129166.639880:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129166.639881:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3a00 already unused, calling callback (ffffffffc1c28c20) 00010000:00010000:3.0:1789129166.639883:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789129166.639885:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.639893:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129166.639895:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129166.639903:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129166.639909:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789129166.639946:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.639953:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789129166.639995:0:12054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fe580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12054:1876037626559488:0@lo:104: 00000100:00100000:1.0:1789129166.640002:0:12054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12054:1876037626559616:0@lo:104: 00000100:00100000:1.0:1789129166.640006:0:12054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12054:1876037626559744:0@lo:104: 00000100:00100000:1.0:1789129166.640211:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626559872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129166.640237:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129166.640265:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129166.640269:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626560000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129166.640281:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129166.640303:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626559872 00000100:00100000:1.0:1789129166.640307:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626559872 00010000:00010000:1.0:1789129166.640332:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b48151b400/0x5c74554e47ce43c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce43be expref: 19 pid: 5835 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.640351:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.640357:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626560000 00010000:00010000:0.0:1789129166.640362:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce43a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce43a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.640363:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626560000 00010000:00010000:1.0:1789129166.640377:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4829d4a00/0x5c74554e47ce43b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce43b0 expref: 20 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.640387:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129166.640390:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129166.640393:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129166.640401:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789129166.640405:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789129166.640411:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+20:3308:x1876037626559872:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789129166.640421:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626560128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789129166.640438:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129166.640446:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b48151b400/0x5c74554e47ce43c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce43be expref: 20 pid: 5835 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.640456:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b48151b400/0x5c74554e47ce43c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce43be expref: 20 pid: 5835 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129166.640457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789129166.640477:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151b400/0x5c74554e47ce43c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce43be expref: 20 pid: 5835 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129166.640485:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626560128 00010000:00010000:1.0:1789129166.640491:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129166.640491:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626560128 00010000:00010000:0.0:1789129166.640512:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce43a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce43a2 expref: 20 pid: 5835 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.640531:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+20:3308:x1876037626559872:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129166.640532:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789129166.640547:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789129166.640547:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+20:3308:x1876037626560000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789129166.640558:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129166.640564:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4829d4a00/0x5c74554e47ce43b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce43b0 expref: 19 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.640570:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1789129166.640579:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4829d4a00/0x5c74554e47ce43b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce43b0 expref: 19 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.640583:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626560128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789129166.640622:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d4a00/0x5c74554e47ce43b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce43b0 expref: 19 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.640633:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129166.640639:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129166.640646:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce43a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce43a2 expref: 18 pid: 5835 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.640656:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce43a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce43a2 expref: 18 pid: 5835 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129166.640663:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:3308:x1876037626560000:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (376us total) trans 0 rc 0/0 00010000:00010000:1.0:1789129166.640674:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce43a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce43a2 expref: 18 pid: 5835 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.640685:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129166.640692:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789129166.640720:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3307:x1876037626560128:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129166.640735:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789129166.640738:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626560128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129166.640768:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626560000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129166.640778:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626559872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129166.647461:0:12054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12054:1876037626559232:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129166.647476:0:12054:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fe1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12054:1876037626559360:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129166.647520:0:12054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129166.651565:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129166.652147:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604500224 00000100:00100000:0.0:1789129166.652160:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604500224 00010000:00010000:0.0:1789129166.652395:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4829d5c00/0x5c74554e47ce43d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa84a expref: 13 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129166.652444:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1789129166.652455:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b95a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604500224:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129166.652470:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129166.652475:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4829d5c00/0x5c74554e47ce43d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa84a expref: 13 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.652489:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4829d5c00/0x5c74554e47ce43d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa84a expref: 13 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.652508:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d5c00/0x5c74554e47ce43d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa84a expref: 13 pid: 5833 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129166.652523:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129166.652898:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b95a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39f4e36-8626-43c5-a083-60799197f867+12:2370:x1876037604500224:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 444us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129166.652907:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:3.0:1789129166.663489:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129166.663780:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604500352 00000100:00100000:1.0:1789129166.663792:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604500352 00010000:00010000:1.0:1789129166.663852:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce43cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa843 expref: 12 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129166.663901:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789129166.663913:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+12:2369:x1876037604500352:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129166.663933:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129166.663939:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce43cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa843 expref: 12 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.663954:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce43cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa843 expref: 12 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.663975:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b488bf3800/0x5c74554e47ce43cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa843 expref: 12 pid: 5834 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.663992:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.664014:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.664032:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.664039:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.664045:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.664051:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.664057:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129166.664061:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.664069:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.664094:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129166.664107:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129166.664180:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+11:2369:x1876037604500352:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 269us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129166.664188:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00010000:00010000:3.0:1789129166.664329:0:12054:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.664342:0:12054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129166.664349:0:12054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656600/0x5c74554e47ce4507 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129167.047057:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129168.069824:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789129168.069918:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789129168.069923:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b3812fb000 from 10 10000000:01000000:0.0:1789129168.069930:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789129168.069992:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129168.070005:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129168.070036:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129168.070062:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac843c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626560256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789129168.070140:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129168.070201:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129168.070404:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626560256 00000100:00100000:1.0:1789129168.070417:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626560256 00000100:00100000:1.0:1789129168.070486:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789129168.070496:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:5837:x1876037626560256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789129168.070510:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129168.070523:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b481656a00/0x5c74554e47ce4515 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce450e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129168.070547:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656a00/0x5c74554e47ce4515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce450e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129168.070559:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b481656a00/0x5c74554e47ce4515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce450e expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129168.070568:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656a00, rc 0) 00000100:00100000:1.0:1789129168.070646:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626560256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.070653:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789129168.070826:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac843c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626560256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789129168.070843:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129168.070853:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129168.070913:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac843c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626560384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789129168.070958:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129168.070985:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129168.071272:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626560384 00000100:00100000:1.0:1789129168.071277:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626560384 00000100:00100000:1.0:1789129168.071314:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789129168.071322:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626560384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129168.071643:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626560384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.071650:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789129168.071862:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac843c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626560384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129168.071908:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b95a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626560512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129168.071953:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129168.071999:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129168.072201:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626560512 00000100:00100000:0.0:1789129168.072207:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626560512 00000100:00100000:0.0:1789129168.072249:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789129168.072258:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626560512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129168.072442:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626560512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129168.072450:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789129168.072642:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b95a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626560512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129168.073556:0:12067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac84b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12067:1876037626560640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129168.073649:0:12067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129168.073695:0:12067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129168.073768:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626560640 00000100:00100000:1.0:1789129168.073774:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626560640 00000100:00100000:1.0:1789129168.073835:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789129168.073843:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:12067:x1876037626560640:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129168.074744:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:12067:x1876037626560640:12345-0@lo:502:llog_process_th.0 Request processed in 884us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.074756:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789129168.082965:0:12067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac84b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12067:1876037626560640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129168.083027:0:12067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129168.083045:0:12067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129168.083047:0:12067:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789129168.083056:0:12067:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b3812fb000 00000020:00000080:2.0:1789129168.083059:0:12067:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789129168.083197:0:12067:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490368780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12067:1876037626560768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129168.083300:0:12067:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129168.083359:0:12067:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822000 going to sleep for 11 seconds 00000100:00100000:1.0:1789129168.084697:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626560768 00000100:00100000:1.0:1789129168.084709:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626560768 00000100:00100000:1.0:1789129168.084801:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789129168.084814:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:12067:x1876037626560768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129168.085142:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:12067:x1876037626560768:12345-0@lo:502:llog_process_th.0 Request processed in 331us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.085151:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789129168.087243:0:12067:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490368780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12067:1876037626560768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129168.087299:0:12067:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129168.087311:0:12067:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129168.087314:0:12067:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789129168.087320:0:12067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789129168.098638:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789129168.098677:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789129168.098689:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129168.098703:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129168.098715:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789129168.098718:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b492084000 from 10 10000000:01000000:0.0:1789129168.098721:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789129168.098773:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129168.098791:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129168.098805:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129168.098831:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626560896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789129168.098903:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129168.098959:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129168.099250:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626560896 00000100:00100000:1.0:1789129168.099258:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626560896 00000100:00100000:1.0:1789129168.099318:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789129168.099328:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:5837:x1876037626560896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789129168.099342:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129168.099356:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b481656800/0x5c74554e47ce4523 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce451c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129168.099398:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b481656800/0x5c74554e47ce4523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce451c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129168.099409:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b481656800/0x5c74554e47ce4523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce451c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129168.099419:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656800, rc 0) 00000100:00100000:1.0:1789129168.099467:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626560896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.099488:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789129168.102772:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626560896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789129168.102824:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129168.102840:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129168.102965:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626561024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789129168.103032:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129168.103073:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129168.103289:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626561024 00000100:00100000:1.0:1789129168.103296:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626561024 00000100:00100000:1.0:1789129168.103345:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789129168.103354:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626561024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129168.103676:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626561024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.103683:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789129168.103934:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626561024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789129168.103972:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626561152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129168.104010:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129168.104164:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129168.104206:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626561152 00000100:00100000:1.0:1789129168.104211:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626561152 00000100:00100000:1.0:1789129168.104245:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789129168.104252:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626561152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129168.107032:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626561152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2768us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.107048:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789129168.107899:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac870c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626561152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129168.110517:0:12070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac870c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12070:1876037626561280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129168.110635:0:12070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129168.110672:0:12070:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129168.110744:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626561280 00000100:00100000:1.0:1789129168.110751:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626561280 00000100:00100000:1.0:1789129168.110817:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789129168.110827:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:12070:x1876037626561280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129168.111061:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:12070:x1876037626561280:12345-0@lo:502:llog_process_th.0 Request processed in 235us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.111069:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789129168.111293:0:12070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac870c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12070:1876037626561280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129168.111323:0:12070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129168.111335:0:12070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129168.111337:0:12070:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789129168.111345:0:12070:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b492084000 00000020:00000080:2.0:1789129168.111348:0:12070:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789129168.111439:0:12070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490368780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12070:1876037626561408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129168.111480:0:12070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129168.111501:0:12070:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5822000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129168.113051:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626561408 00000100:00100000:0.0:1789129168.113070:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626561408 00000100:00100000:0.0:1789129168.113142:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789129168.113153:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:12070:x1876037626561408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129168.113529:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:12070:x1876037626561408:12345-0@lo:502:llog_process_th.0 Request processed in 377us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129168.113537:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789129168.113646:0:12070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490368780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12070:1876037626561408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789129168.113678:0:12070:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789129168.113686:0:12070:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129168.113688:0:12070:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789129168.113693:0:12070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789129168.114477:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789129168.114501:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789129168.114513:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129168.114537:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129168.114551:0:5837:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789129168.114555:0:5837:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4921dd800 from 10 10000000:01000000:1.0:1789129168.114558:0:5837:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789129168.114644:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129168.114652:0:5837:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129168.114663:0:5837:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129168.114689:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626561536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789129168.114748:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129168.114803:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44000 going to sleep for 11 seconds 00000100:00100000:2.0:1789129168.116578:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626561536 00000100:00100000:2.0:1789129168.116595:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626561536 00000100:00100000:2.0:1789129168.116675:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789129168.116687:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:5837:x1876037626561536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129168.116705:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129168.116726:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151ba00/0x5c74554e47ce4531 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce452a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129168.116758:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151ba00/0x5c74554e47ce4531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce452a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129168.116771:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151ba00/0x5c74554e47ce4531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce452a expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129168.116791:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151ba00, rc 0) 00000100:00100000:2.0:1789129168.116891:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626561536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129168.116898:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789129168.117163:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626561536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789129168.117181:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129168.117191:0:5837:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129168.117275:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626561664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129168.117316:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129168.117366:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129168.120230:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626561664 00000100:00100000:0.0:1789129168.120256:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626561664 00000100:00100000:0.0:1789129168.120336:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789129168.120348:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626561664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789129168.120789:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626561664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 432us (3461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129168.120798:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789129168.121732:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626561664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129168.121812:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626561792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129168.121883:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129168.121933:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44000 going to sleep for 11 seconds 00000100:00100000:2.0:1789129168.121987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626561792 00000100:00100000:2.0:1789129168.121993:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626561792 00000100:00100000:2.0:1789129168.122037:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789129168.122049:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626561792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129168.122256:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:5837:x1876037626561792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129168.122263:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789129168.122358:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4a927c41-01d5-424a-b17c-4bdb2d4e760d:5837:1876037626561792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129168.126149:0:12071:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12071:1876037626561920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129168.126254:0:12071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129168.126305:0:12071:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44240 going to sleep for 11 seconds 00000100:00100000:2.0:1789129168.126360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626561920 00000100:00100000:2.0:1789129168.126368:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626561920 00000100:00100000:2.0:1789129168.126431:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789129168.126441:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:12071:x1876037626561920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129168.126759:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:12071:x1876037626561920:12345-0@lo:502:llog_process_th.0 Request processed in 317us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129168.126767:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789129168.126970:0:12071:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12071:1876037626561920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789129168.127007:0:12071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789129168.127018:0:12071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129168.127020:0:12071:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789129168.127028:0:12071:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b4921dd800 00000020:00000080:0.0:1789129168.127030:0:12071:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789129168.127113:0:12071:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bac84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12071:1876037626562048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129168.127151:0:12071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129168.127178:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626562048 00000100:00100000:0.0:1789129168.127182:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626562048 00000100:00100000:0.0:1789129168.127205:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789129168.127212:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:12071:x1876037626562048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129168.127344:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:12071:x1876037626562048:12345-0@lo:502:llog_process_th.0 Request processed in 132us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129168.127351:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789129168.127392:0:12071:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbe900 going to sleep for 11 seconds 00000100:00100000:0.0:1789129168.127407:0:12071:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bac84000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4a927c41-01d5-424a-b17c-4bdb2d4e760d:12071:1876037626562048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789129168.127426:0:12071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789129168.127430:0:12071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129168.127438:0:12071:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789129168.127442:0:12071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789129168.128214:0:5837:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789129168.128239:0:5837:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789129168.128251:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129168.128263:0:5837:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789129168.129673:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789129168.281160:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129168.284670:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604500480 00000100:00100000:0.0:1789129168.284687:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604500480 00000100:00100000:2.0:1789129168.284900:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 305 00000100:00100000:2.0:1789129168.284911:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+11:5613:x1876037604500480:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129168.284945:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129168.284965:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b48151b000/0x5c74554e47ce4538 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa897 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129168.284995:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b48151b000/0x5c74554e47ce4538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa897 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129168.285006:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b48151b000/0x5c74554e47ce4538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa897 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129168.285015:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b000, rc 0) 00000100:00100000:2.0:1789129168.285087:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604500480:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 177us (3936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129168.285095:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 305 00000100:00100000:0.0:1789129168.292341:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129168.292504:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604500608 00000100:00100000:2.0:1789129168.292516:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604500608 00000100:00100000:2.0:1789129168.292957:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 306 00000100:00100000:2.0:1789129168.292976:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604500608:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129168.293307:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604500608:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 332us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129168.293316:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 306 00000100:00100000:3.0:1789129168.300016:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129168.300370:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604500736 00000100:00100000:2.0:1789129168.300383:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604500736 00000100:00100000:2.0:1789129168.300519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 307 00000100:00100000:2.0:1789129168.300530:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604500736:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129168.300945:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604500736:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 415us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129168.300962:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 307 00000100:00100000:3.0:1789129168.321161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129168.321772:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604500864 00000100:00100000:2.0:1789129168.321792:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604500864 00000100:00100000:2.0:1789129168.321856:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 308 00000100:00100000:2.0:1789129168.321867:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+12:10176:x1876037604500864:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789129168.322132:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+12:10176:x1876037604500864:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 266us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129168.322140:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 308 00000100:00100000:0.0:1789129168.331320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129168.331571:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604500992 00000100:00100000:1.0:1789129168.331593:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604500992 00000100:00100000:1.0:1789129168.331692:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 309 00000100:00100000:1.0:1789129168.331703:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+12:10176:x1876037604500992:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789129168.332481:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+12:10176:x1876037604500992:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 774us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.332492:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 309 00000100:00100000:3.0:1789129168.342294:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129168.343405:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604501120 00000100:00100000:0.0:1789129168.343419:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604501120 00000100:00100000:0.0:1789129168.343491:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 310 00000100:00100000:0.0:1789129168.343502:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+12:5613:x1876037604501120:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789129168.343520:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129168.343541:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b490363200/0x5c74554e47ce453f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aa89e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129168.343571:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490363200/0x5c74554e47ce453f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa89e expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129168.343581:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b490363200/0x5c74554e47ce453f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa89e expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129168.343590:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363200, rc 0) 00000100:00100000:0.0:1789129168.343713:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604501120:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 212us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129168.343719:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 310 00000100:00100000:3.0:1789129168.359228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129168.359349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604501248 00000100:00100000:2.0:1789129168.359361:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604501248 00000100:00100000:2.0:1789129168.359434:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 311 00000100:00100000:2.0:1789129168.359444:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604501248:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129168.359990:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604501248:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 544us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129168.360000:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 311 00000100:00100000:3.0:1789129168.364002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129168.364359:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604501376 00000100:00100000:1.0:1789129168.364372:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604501376 00000100:00100000:1.0:1789129168.364445:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 312 00000100:00100000:1.0:1789129168.364453:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604501376:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129168.364754:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:5613:x1876037604501376:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 299us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.364762:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 312 00000100:00100000:3.0:1789129168.368945:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129168.369193:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604501504 00000100:00100000:0.0:1789129168.369204:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604501504 00000100:00100000:0.0:1789129168.369262:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 313 00000100:00100000:0.0:1789129168.369271:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:10179:x1876037604501504:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789129168.369522:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:10179:x1876037604501504:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 250us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129168.369536:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 313 00000100:00100000:3.0:1789129168.375239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129168.375395:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604501632 00000100:00100000:1.0:1789129168.375420:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604501632 00000100:00100000:1.0:1789129168.375493:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 314 00000100:00100000:1.0:1789129168.375505:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:10179:x1876037604501632:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789129168.376897:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:10179:x1876037604501632:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 1383us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.376913:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 314 00000100:00100000:3.0:1789129168.925045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129168.925109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129168.925149:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129168.925193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129168.925250:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604501888 00000100:00100000:3.0:1789129168.925263:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604501888 00000100:00100000:3.0:1789129168.925337:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604502144 00000100:00100000:3.0:1789129168.925341:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604502144 00000100:00100000:3.0:1789129168.925365:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:3.0:1789129168.925374:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604501888:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129168.925455:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604501888:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 82us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129168.925464:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:3.0:1789129168.925481:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:3.0:1789129168.925489:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604502144:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129168.925513:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604502144:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129168.925539:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:1.0:1789129168.926241:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604502016 00000100:00100000:1.0:1789129168.926249:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604502016 00000100:00100000:1.0:1789129168.926300:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1789129168.926308:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604502016:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129168.926361:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604502016:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 53us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129168.926367:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00080000:1.0:1789129168.926387:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789129168.926392:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129168.926560:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604501760 00000100:00100000:2.0:1789129168.926566:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604501760 00000100:00100000:2.0:1789129168.926627:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 315 00000100:00100000:2.0:1789129168.926636:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604501760:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129168.926666:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604501760:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 32us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129168.926673:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 315 00010000:00010000:0.0:1789129169.093835:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789129169.158328:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789129170.118188:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129170.182198:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129170.182240:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626562176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789129170.182866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129170.182952:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626562176 00000100:00100000:2.0:1789129170.182965:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626562176 00000100:00100000:2.0:1789129170.183097:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789129170.183113:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626562176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129170.183167:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129170.183260:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626562176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129170.183269:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789129170.183357:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789129170.183593:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b490369680 x1876037626562176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129170.183653:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626562176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789129171.141982:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129171.719289:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626562688:0@lo:400:kworker.0 00000100:00100000:1.0:1789129171.719397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129171.719478:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789129171.719484:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626562560:0@lo:400:kworker.0 00000100:00100000:1.0:1789129171.719509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129171.719542:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626562688 00000100:00100000:1.0:1789129171.719548:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626562688 00000100:00100000:1.0:1789129171.719590:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789129171.719599:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626562688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129171.719952:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626562688:12345-0@lo:400:kworker.0 Request processed in 350us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129171.719978:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789129171.720005:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626562560 00000100:00100000:1.0:1789129171.720009:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626562560 00000100:00100000:1.0:1789129171.720050:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789129171.720057:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626562560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129171.720094:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626562560:12345-0@lo:400:kworker.0 Request processed in 37us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129171.720099:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1789129171.720121:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129171.720154:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626562560:0@lo:400:kworker.0 00010000:00080000:1.0:1789129171.720168:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902fed00 x1876037626562688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129171.720177:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626562688:0@lo:400:kworker.0 00000100:00100000:3.0:1789129171.720281:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626562304:0@lo:400:kworker.0 00000100:00100000:3.0:1789129171.720322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129171.720353:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626562816:0@lo:400:kworker.0 00000100:00100000:3.0:1789129171.720377:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129171.720414:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789129171.720420:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626562432:0@lo:400:kworker.0 00000100:00100000:3.0:1789129171.720444:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129171.720462:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626562944:0@lo:400:kworker.0 00000100:00100000:3.0:1789129171.720483:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129171.720506:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626562816 00000100:00100000:3.0:1789129171.720510:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626562816 00000100:00100000:3.0:1789129171.720537:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626562432 00000100:00100000:3.0:1789129171.720540:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626562432 00000100:00100000:3.0:1789129171.720555:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789129171.720562:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626562816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129171.720595:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626562816:12345-0@lo:400:kworker.0 Request processed in 34us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129171.720620:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789129171.720633:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789129171.720639:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626562432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129171.720664:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626562432:12345-0@lo:400:kworker.0 Request processed in 25us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129171.720812:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789129171.720846:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129171.720866:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626562432:0@lo:400:kworker.0 00000100:00100000:3.0:1789129171.720875:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626562816:0@lo:400:kworker.0 00000100:00100000:3.0:1789129171.720918:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626562304 00000100:00100000:3.0:1789129171.720921:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626562304 00000100:00100000:3.0:1789129171.720946:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789129171.720952:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626562304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129171.720986:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626562304:12345-0@lo:400:kworker.0 Request processed in 34us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129171.720992:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789129171.721020:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626562304:0@lo:400:kworker.0 00000100:00100000:0.0:1789129171.721337:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626562944 00000100:00100000:0.0:1789129171.721342:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626562944 00000100:00100000:0.0:1789129171.721397:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789129171.721404:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626562944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129171.721444:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626562944:12345-0@lo:400:kworker.0 Request processed in 41us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129171.721450:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789129171.721475:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626562944:0@lo:400:kworker.0 00000100:00100000:1.0:1789129171.722355:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789129171.722377:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4903683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626563072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129171.722460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129171.723066:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626563072 00000100:00100000:2.0:1789129171.723074:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626563072 00000100:00100000:2.0:1789129171.723125:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789129171.723134:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626563072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129171.723171:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129171.723232:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626563072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129171.723241:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789129171.723393:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789129171.723562:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4903683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626563072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789129172.166090:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129173.189959:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129174.041235:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129174.041349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129174.041382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129174.041422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129174.041457:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604502400 00000100:00100000:3.0:1789129174.041468:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604502400 00000100:00100000:3.0:1789129174.041530:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604502656 00000100:00100000:3.0:1789129174.041534:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604502656 00000100:00100000:3.0:1789129174.041560:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:3.0:1789129174.041571:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604502400:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129174.042943:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604502528 00000100:00100000:1.0:1789129174.042954:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604502528 00000100:00100000:1.0:1789129174.043021:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:1.0:1789129174.043031:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604502528:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129174.043108:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604502528:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 79us (1768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129174.043116:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:1.0:1789129174.043189:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:1.0:1789129174.043200:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604502656:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129174.043231:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604502656:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129174.043238:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00080000:1.0:1789129174.043259:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789129174.043264:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129174.043381:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604502400:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 1810us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129174.043396:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:0.0:1789129174.046957:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604502272 00000100:00100000:0.0:1789129174.046978:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604502272 00000100:00100000:0.0:1789129174.047068:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 317 00000100:00100000:0.0:1789129174.047080:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604502272:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129174.047620:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604502272:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 521us (6375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129174.047638:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 317 00010000:00010000:3.0:1789129174.215802:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129175.237791:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129175.303475:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b49036bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626563200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129175.303575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129175.303774:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626563200 00000100:00100000:2.0:1789129175.303783:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626563200 00000100:00100000:2.0:1789129175.303855:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789129175.303866:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382103840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626563200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129175.303907:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129175.303956:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382103840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626563200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129175.303964:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789129175.304014:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b49036bc00 x1876037626563200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129175.304035:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b49036bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626563200:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789129175.304101:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789129176.264688:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129176.839146:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626563456:0@lo:400:kworker.0 00000100:00100000:3.0:1789129176.839235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129176.839256:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626563328:0@lo:400:kworker.0 00000100:00100000:3.0:1789129176.839284:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626563968:0@lo:400:kworker.0 00000100:00100000:0.0:1789129176.839288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129176.839308:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129176.839310:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626563840:0@lo:400:kworker.0 00000100:00100000:0.0:1789129176.839331:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129176.839433:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3821003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626563584:0@lo:400:kworker.0 00000100:00100000:3.0:1789129176.839458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129176.839476:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129176.839481:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382102d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626563712:0@lo:400:kworker.0 00000100:00100000:3.0:1789129176.839499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129176.839522:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626563968 00000100:00100000:3.0:1789129176.839528:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626563968 00000100:00100000:3.0:1789129176.840421:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626563712 00000100:00100000:3.0:1789129176.840429:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626563712 00000100:00100000:3.0:1789129176.840448:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789129176.840458:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626563968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129176.840536:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626563968:12345-0@lo:400:kworker.0 Request processed in 79us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129176.840558:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789129176.840585:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789129176.840592:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626563712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129176.840972:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626563712:12345-0@lo:400:kworker.0 Request processed in 379us (1470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129176.840979:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789129176.841075:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626563456 00000100:00100000:3.0:1789129176.841080:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626563456 00000100:00100000:3.0:1789129176.841113:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626563840 00000100:00100000:3.0:1789129176.841116:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626563840 00000100:00100000:3.0:1789129176.841127:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626563584 00000100:00100000:3.0:1789129176.841129:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626563584 00000100:00100000:3.0:1789129176.841141:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789129176.841147:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626563456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129176.841179:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626563456:12345-0@lo:400:kworker.0 Request processed in 32us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129176.841185:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789129176.841906:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789129176.841919:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626563840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129176.841966:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626563840:12345-0@lo:400:kworker.0 Request processed in 53us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129176.841973:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789129176.841984:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789129176.841989:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626563584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129176.842514:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789129176.842546:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b49036bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626564096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129176.842576:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626563584:12345-0@lo:400:kworker.0 Request processed in 587us (3117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129176.842587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129176.842594:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789129176.842656:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626563328 00000100:00100000:2.0:1789129176.842664:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626563328 00000100:00100000:2.0:1789129176.842716:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789129176.842724:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626563328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129176.842761:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626563328:12345-0@lo:400:kworker.0 Request processed in 38us (3471us total) trans 0 rc 0/0 00000100:00080000:3.0:1789129176.843168:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789129176.843176:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789129176.843284:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b382102d00 x1876037626563712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129176.843317:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382102d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626563712:0@lo:400:kworker.0 00000100:00100000:3.0:1789129176.843337:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3821003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626563584:0@lo:400:kworker.0 00000100:00100000:2.0:1789129176.843364:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789129176.843389:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626563456:0@lo:400:kworker.0 00000100:00100000:3.0:1789129176.843404:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626563968:0@lo:400:kworker.0 00000100:00100000:2.0:1789129176.843424:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626564096 00000100:00100000:2.0:1789129176.843428:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626564096 00000100:00100000:2.0:1789129176.843457:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789129176.843464:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490368b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626564096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129176.843503:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129176.843547:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490368b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626564096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129176.843553:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789129176.843585:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b49036bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626564096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129176.846056:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626563328:0@lo:400:kworker.0 00000100:00100000:0.0:1789129176.846080:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626563840:0@lo:400:kworker.0 00010000:00010000:2.0:1789129177.302839:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129178.310195:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129179.161143:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129179.161203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129179.161262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129179.161303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129179.161316:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604502912 00000100:00100000:0.0:1789129179.161329:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604502912 00000100:00100000:3.0:1789129179.161330:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604503168 00000100:00100000:3.0:1789129179.161333:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604503168 00000100:00100000:1.0:1789129179.161386:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604502784 00000100:00100000:1.0:1789129179.161391:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604502784 00000100:00100000:1.0:1789129179.161450:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 319 00000100:00100000:1.0:1789129179.161462:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604502784:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129179.161574:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48648c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604502784:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 113us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129179.161593:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 319 00000100:00100000:3.0:1789129179.162894:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:3.0:1789129179.162915:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604503168:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129179.163015:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604503168:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 107us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129179.163024:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:2.0:1789129179.163403:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604503040 00000100:00100000:2.0:1789129179.163426:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604503040 00000100:00100000:0.0:1789129179.171857:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:0.0:1789129179.171885:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604502912:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129179.172028:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604502912:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 157us (10822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129179.172038:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00080000:1.0:1789129179.173166:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129179.177819:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:2.0:1789129179.177838:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604503040:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129179.177926:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604503040:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 94us (16677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129179.177933:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00080000:1.0:1789129179.178101:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789129179.333996:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789129179.398285:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789129180.358720:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129180.421890:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129180.421915:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b49036bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626564224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789129180.421990:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129180.422331:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626564224 00000100:00100000:2.0:1789129180.422341:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626564224 00000100:00100000:2.0:1789129180.422423:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789129180.422434:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626564224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129180.422476:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129180.422538:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626564224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129180.422545:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1789129180.422659:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b49036bc00 x1876037626564224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129180.422684:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b49036bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626564224:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789129180.422820:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789129181.381849:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129181.957994:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b49036b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626564352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129181.958123:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129181.958462:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626564352 00000100:00100000:2.0:1789129181.958474:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626564352 00000100:00100000:2.0:1789129181.958580:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789129181.958595:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626564352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129181.958675:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129181.958742:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626564352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129181.958750:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789129181.958938:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b49036b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626564352:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789129181.959020:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129181.959574:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789129181.959839:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626564736:0@lo:400:kworker.0 00000100:00100000:3.0:1789129181.959910:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129181.959967:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789129181.959974:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626564608:0@lo:400:kworker.0 00000100:00100000:3.0:1789129181.960012:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129181.960071:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626564736 00000100:00100000:3.0:1789129181.960078:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626564736 00000100:00100000:3.0:1789129181.960147:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626564608 00000100:00100000:3.0:1789129181.960151:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626564608 00000100:00100000:3.0:1789129181.960176:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789129181.960187:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626564736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129181.960243:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626564736:12345-0@lo:400:kworker.0 Request processed in 58us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129181.960266:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789129181.960285:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789129181.960291:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626564608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129181.960322:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626564608:12345-0@lo:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129181.960328:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:3.0:1789129181.960348:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129181.960378:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626564608:0@lo:400:kworker.0 00000100:00100000:3.0:1789129181.960390:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626564736:0@lo:400:kworker.0 00000100:00100000:0.0:1789129181.964769:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626564864:0@lo:400:kworker.0 00000100:00100000:0.0:1789129181.964866:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129181.965161:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626564864 00000100:00100000:3.0:1789129181.965176:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626564864 00000100:00100000:3.0:1789129181.965264:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789129181.965277:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626564864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129181.965292:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626564480:0@lo:400:kworker.0 00000100:00100000:0.0:1789129181.965343:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129181.965407:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626564864:12345-0@lo:400:kworker.0 Request processed in 130us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129181.965418:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1789129181.965434:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902fd680 x1876037626564864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129181.965454:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626564864:0@lo:400:kworker.0 00000100:00100000:3.0:1789129181.965588:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626564480 00000100:00100000:3.0:1789129181.965595:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626564480 00000100:00100000:3.0:1789129181.965677:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789129181.965706:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626564480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129181.965835:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626564480:12345-0@lo:400:kworker.0 Request processed in 131us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129181.965842:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789129181.966857:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626564992:0@lo:400:kworker.0 00000100:00100000:3.0:1789129181.966932:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129181.967279:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626564992 00000100:00100000:1.0:1789129181.967289:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626564992 00000100:00100000:1.0:1789129181.967369:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789129181.967381:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626564992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129181.967460:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626564992:12345-0@lo:400:kworker.0 Request processed in 82us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129181.967468:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789129181.967596:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626564992:0@lo:400:kworker.0 00000100:00080000:3.0:1789129181.967685:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129181.973751:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626564480:0@lo:400:kworker.0 00010000:00010000:3.0:1789129182.405973:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129183.435173:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129184.282435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129184.282516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129184.282565:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604503296 00000100:00100000:2.0:1789129184.282578:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604503296 00000100:00100000:2.0:1789129184.282694:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 321 00000100:00100000:2.0:1789129184.282708:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604503296:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129184.282811:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604503296:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 106us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129184.282820:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 321 00000100:00100000:0.0:1789129184.283084:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604503424 00000100:00100000:0.0:1789129184.283090:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604503424 00000100:00100000:0.0:1789129184.283158:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:0.0:1789129184.283166:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604503424:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129184.283204:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604503424:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 40us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129184.283211:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00080000:1.0:1789129184.283268:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129184.308396:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129184.308645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129184.308792:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604503552 00000100:00100000:0.0:1789129184.308806:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604503552 00000100:00100000:0.0:1789129184.308922:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789129184.308935:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2366:x1876037604503552:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:0.0:1789129184.309015:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce447b 00000100:00080000:0.0:1789129184.309029:0:6686:0:(import.c:65:import_set_state_nolock()) ffff90b485cb2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789129184.309090:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789129184.309476:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+2:2366:x1876037604503552:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 542us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129184.309506:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00010000:00010000:0.0:1789129184.309536:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789129184.313008:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129184.314358:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604503680 00000100:00100000:3.0:1789129184.314379:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604503680 00000100:00100000:3.0:1789129184.315116:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:3.0:1789129184.316273:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604503680:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129184.316412:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604503680:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 159us (8032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129184.316421:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00080000:1.0:1789129184.320270:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789129184.456941:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129185.479349:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129185.542289:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626565120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129185.542407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129185.542535:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626565120 00000100:00100000:2.0:1789129185.542546:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626565120 00000100:00100000:2.0:1789129185.542647:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789129185.542659:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626565120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129185.542706:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129185.542769:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626565120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129185.542778:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1789129185.542806:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789129185.542880:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b490368000 x1876037626565120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129185.542906:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626565120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789129186.501930:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789129186.635020:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:0.0:1789129186.635034:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b485cb1800/9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:2.0:1789129186.635539:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90b485cb1800/9463e625-4f12-4089-85aa-d90aafb8e5a9 for lustre-OST0001 00000020:00000080:2.0:1789129186.635668:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b485cb2800 for lustre-OST0001 00000100:00100000:2.0:1789129187.079345:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b49036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626565248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129187.079465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129187.079567:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626565248 00000100:00100000:2.0:1789129187.079576:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626565248 00000100:00080000:3.0:1789129187.080297:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129187.080313:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626565632:0@lo:400:kworker.0 00000100:00100000:3.0:1789129187.080364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129187.080399:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129187.080405:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626565760:0@lo:400:kworker.0 00000100:00100000:3.0:1789129187.080434:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129187.080494:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626565760 00000100:00100000:3.0:1789129187.080499:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626565760 00000100:00100000:3.0:1789129187.080579:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789129187.080591:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626565760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129187.081042:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789129187.081052:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626565248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129187.082720:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129187.082862:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626565248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1807us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129187.082896:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789129187.083066:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626565376:0@lo:400:kworker.0 00000100:00100000:0.0:1789129187.083137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129187.083183:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3821003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626565888:0@lo:400:kworker.0 00000100:00100000:3.0:1789129187.083408:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626565760:12345-0@lo:400:kworker.0 Request processed in 2818us (2971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129187.083419:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789129187.083467:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789129187.083511:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b382101680 x1876037626565760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129187.083528:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626565760:0@lo:400:kworker.0 00000100:00100000:3.0:1789129187.083632:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b49036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626565248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129187.083706:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626565376 00000100:00100000:3.0:1789129187.083712:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626565376 00000100:00100000:3.0:1789129187.083751:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789129187.083760:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626565376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129187.083795:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626565376:12345-0@lo:400:kworker.0 Request processed in 36us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129187.083803:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789129187.083839:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626565632 00000100:00100000:3.0:1789129187.083844:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626565632 00000100:00100000:3.0:1789129187.083883:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789129187.083891:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382102d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626565632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129187.083942:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382102d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626565632:12345-0@lo:400:kworker.0 Request processed in 52us (3578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129187.083949:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789129187.083971:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626565504:0@lo:400:kworker.0 00000100:00100000:3.0:1789129187.084017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129187.084057:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626565504 00000100:00100000:3.0:1789129187.084061:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626565504 00000100:00100000:3.0:1789129187.084089:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789129187.084095:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626565504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129187.084318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129187.084363:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626565376:0@lo:400:kworker.0 00000100:00100000:0.0:1789129187.084396:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626565888 00000100:00100000:0.0:1789129187.084400:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626565888 00000100:00100000:0.0:1789129187.084424:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789129187.084431:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626565888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129187.084478:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626565888:12345-0@lo:400:kworker.0 Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129187.084484:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789129187.084514:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3821003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626565888:0@lo:400:kworker.0 00000100:00080000:2.0:1789129187.086631:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129187.086698:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626565632:0@lo:400:kworker.0 00000100:00100000:3.0:1789129187.090082:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626565504:12345-0@lo:400:kworker.0 Request processed in 5970us (6049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129187.090104:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789129187.099294:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626565504:0@lo:400:kworker.0 00010000:00010000:3.0:1789129187.526404:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129188.549767:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129189.413373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129189.413435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129189.413507:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604503808 00000100:00100000:2.0:1789129189.413517:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604503808 00000100:00100000:2.0:1789129189.413573:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 323 00000100:00100000:2.0:1789129189.413584:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2368:x1876037604503808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129189.413675:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2368:x1876037604503808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 92us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129189.413688:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 323 00000100:00100000:1.0:1789129189.414283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129189.417680:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604504064 00000100:00100000:3.0:1789129189.417696:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604504064 00000100:00100000:3.0:1789129189.417766:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604503936 00000100:00100000:3.0:1789129189.417770:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604503936 00000100:00100000:3.0:1789129189.417804:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:3.0:1789129189.417815:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604504064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129189.417917:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604504064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 103us (4481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129189.417925:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:3.0:1789129189.417944:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:3.0:1789129189.417951:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604503936:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129189.417978:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2368:x1876037604503936:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (3697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129189.417984:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00080000:2.0:1789129189.423085:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789129189.573811:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789129189.638313:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789129190.597825:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129190.667271:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626566016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789129190.667392:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129190.667713:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626566016 00000100:00100000:3.0:1789129190.667722:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626566016 00000100:00100000:3.0:1789129190.667803:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789129190.667813:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626566016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129190.667863:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789129190.668059:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129190.668260:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626566016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 448us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129190.668268:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1789129190.668547:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902fc000 x1876037626566016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129190.668582:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626566016:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789129191.060504:0:12234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:19:49 (1789129189) 00010000:00010000:2.0:1789129191.622647:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129192.197984:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382748f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626566400:0@lo:400:kworker.0 00000100:00100000:3.0:1789129192.198113:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129192.198218:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789129192.198225:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626566528:0@lo:400:kworker.0 00000100:00100000:3.0:1789129192.198257:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129192.198422:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38274b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626566272:0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.198460:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129192.198483:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626566784:0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.198506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129192.198528:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789129192.198533:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38274b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626566144:0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.198573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129192.198595:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382748b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626566656:0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.198648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129192.198703:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626566400 00000100:00100000:1.0:1789129192.198713:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626566400 00000100:00100000:1.0:1789129192.198793:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626566272 00000100:00100000:1.0:1789129192.198796:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626566272 00000100:00100000:1.0:1789129192.198813:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626566656 00000100:00100000:1.0:1789129192.198815:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626566656 00000100:00100000:1.0:1789129192.198836:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789129192.198846:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382100b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626566400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.198923:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382100b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626566400:12345-0@lo:400:kworker.0 Request processed in 77us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129192.198932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789129192.198954:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789129192.198961:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626566272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.199019:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626566272:12345-0@lo:400:kworker.0 Request processed in 58us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129192.199026:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789129192.199039:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789129192.199046:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626566656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.199075:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626566656:12345-0@lo:400:kworker.0 Request processed in 29us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129192.199081:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789129192.199100:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626566528 00000100:00100000:1.0:1789129192.199104:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626566528 00000100:00100000:1.0:1789129192.199132:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626566784 00000100:00100000:1.0:1789129192.199135:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626566784 00000100:00100000:1.0:1789129192.199152:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789129192.199158:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382100780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626566528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.199195:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382100780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626566528:12345-0@lo:400:kworker.0 Request processed in 38us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129192.199201:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789129192.199212:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789129192.199218:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626566784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.199249:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626566784:12345-0@lo:400:kworker.0 Request processed in 32us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129192.199254:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789129192.199650:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382748b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626566656:0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.199675:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38274b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626566272:0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.199688:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626566784:0@lo:400:kworker.0 00010000:00080000:1.0:1789129192.199793:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b382749a40 x1876037626566528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789129208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129192.199807:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626566528:0@lo:400:kworker.0 00000100:00100000:1.0:1789129192.199825:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382748f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626566400:0@lo:400:kworker.0 00000100:00100000:2.0:1789129192.201807:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626566144 00000100:00100000:2.0:1789129192.201821:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626566144 00000100:00100000:2.0:1789129192.201904:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789129192.201917:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626566144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129192.202043:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626566144:12345-0@lo:400:kworker.0 Request processed in 128us (3468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129192.202051:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:2.0:1789129192.202105:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789129192.202126:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789129192.202131:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129192.202172:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38274b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626566144:0@lo:400:kworker.0 00000100:00100000:0.0:1789129192.202296:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129192.202326:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626566912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129192.202392:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129192.203346:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626566912 00000100:00100000:2.0:1789129192.203388:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626566912 00000100:00100000:2.0:1789129192.203463:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789129192.203474:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626566912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129192.203523:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129192.203638:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626566912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129192.203647:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789129192.204036:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626566912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789129192.646674:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129193.229844:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129193.230066:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604504192 00000100:00100000:1.0:1789129193.230079:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604504192 00000100:00100000:1.0:1789129193.230231:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1789129193.230246:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:10449:x1876037604504192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129193.230292:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129193.230341:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4546 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8a5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.230441:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce454d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.230458:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce454d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.230476:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce454d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129193.230883:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789129193.230889:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00080000:2.0:1789129193.231464:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1789129193.231711:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce454d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.231757:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8a5 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.231806:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce454d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8a5 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.231823:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b300) 00010000:00010000:1.0:1789129193.231827:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789129193.231832:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657600, rc 0) 00000100:00100000:1.0:1789129193.232652:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:10449:x1876037604504192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2356us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129193.232665:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:2.0:1789129193.261366:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129193.269091:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604504320 00000100:00100000:3.0:1789129193.269369:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604504320 00000100:00100000:3.0:1789129193.269558:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:3.0:1789129193.269571:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:10450:x1876037604504320:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129193.269623:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129193.269656:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8ac expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.269748:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce455b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.269768:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce455b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.269783:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce455b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.269804:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4562 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.269830:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.269837:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270415:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce4569 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270427:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce4569 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270435:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce4569 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129193.270534:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789129193.270540:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129193.270685:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce4569 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270699:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce455b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270707:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce455b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270714:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce455b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270720:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129193.270725:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce455b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270740:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce455b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270756:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b300) 00010000:00010000:3.0:1789129193.270759:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129193.270765:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce455b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270772:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce455b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270788:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4562 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270793:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4562 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270798:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270803:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129193.270805:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4562 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270811:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4562 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270817:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90b4909bd200) 00010000:00010000:3.0:1789129193.270820:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129193.270822:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4562 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270837:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4562 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270880:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8ac expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270895:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce4569 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8ac expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129193.270903:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:3.0:1789129193.270905:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789129193.270907:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2800, rc 0) 00000100:00100000:3.0:1789129193.271008:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:10450:x1876037604504320:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1439us (10494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129193.271017:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789129193.282058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129193.282164:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604504576 00000100:00100000:1.0:1789129193.282178:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604504576 00000100:00100000:1.0:1789129193.282261:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:1.0:1789129193.282274:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:10450:x1876037604504576:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129193.282308:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129193.282341:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4570 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8b3 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.282445:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4577 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.282460:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4577 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.282470:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4577 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.284581:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce457e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.284641:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce457e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.284656:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce457e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285177:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce4585 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285188:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce4585 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285195:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce4585 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129193.285207:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789129193.285402:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4577 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285408:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4577 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285413:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4577 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285416:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129193.285420:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4577 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285426:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4577 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285444:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:1.0:1789129193.285446:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129193.285451:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4577 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285455:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4577 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285473:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce457e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285476:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce457e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285479:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce457e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285483:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129193.285485:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce457e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285488:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce457e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285491:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b49117b900) 00010000:00010000:1.0:1789129193.285493:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129193.285494:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce457e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.285497:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce457e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.286923:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce4570 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8b3 expref: 10 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.286948:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce4585 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8b3 expref: 9 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129193.286955:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:1.0:1789129193.286957:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129193.286959:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656e00, rc 0) 00000100:00100000:1.0:1789129193.287036:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:10450:x1876037604504576:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 4765us (4999us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789129193.287044:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:0.0:1789129193.295134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129193.295668:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604504704 00000100:00100000:2.0:1789129193.295679:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604504704 00000100:00100000:2.0:1789129193.295739:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:2.0:1789129193.295752:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:10450:x1876037604504704:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789129193.295870:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:10450:x1876037604504704:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 120us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129193.295878:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00010000:00010000:1.0:1789129193.670131:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789129193.736580:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789129194.526871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129194.526945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129194.526986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129194.527806:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604504832 00000100:00100000:3.0:1789129194.527827:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604504832 00000100:00100000:3.0:1789129194.527934:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 325 00000100:00100000:3.0:1789129194.528142:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604504832:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129194.528257:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604504832:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 128us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129194.529466:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604505088 00000100:00100000:1.0:1789129194.529487:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604505088 00000100:00100000:1.0:1789129194.529645:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604504960 00000100:00100000:1.0:1789129194.529650:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604504960 00000100:00100000:1.0:1789129194.529688:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:1.0:1789129194.529701:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2370:x1876037604505088:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:0.0:1789129194.529864:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129194.530491:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2370:x1876037604505088:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 784us (3544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129194.530502:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:1.0:1789129194.530532:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:1.0:1789129194.530542:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2370:x1876037604504960:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129194.530599:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2370:x1876037604504960:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 59us (3612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129194.530650:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:3.0:1789129194.533589:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 325 00010000:00010000:3.0:1789129194.694947:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129195.721037:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129195.790772:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129195.790794:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626567040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129195.791738:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129195.806749:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626567040 00000100:00100000:0.0:1789129195.806764:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626567040 00000100:00100000:0.0:1789129195.806827:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789129195.806837:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626567040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129195.806878:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129195.806960:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626567040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (15225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129195.806968:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1789129195.806989:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789129195.807023:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4902fcb40 x1876037626567040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129195.807061:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626567040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129196.193478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129196.193541:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604505216 00000100:00100000:3.0:1789129196.193553:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604505216 00000100:00080000:1.0:1789129196.193630:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129196.193682:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789129196.193707:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:10492:x1876037604505216:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129196.193731:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129196.193754:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.193821:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce459a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.193839:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce459a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.193854:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce459a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.193869:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.193876:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.193882:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194220:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce459a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194230:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce459a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194237:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce459a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194254:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129196.194258:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce459a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194267:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce459a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194291:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b300) 00010000:00010000:3.0:1789129196.194294:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129196.194300:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce459a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194309:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce459a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194320:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194326:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194333:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194338:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129196.194342:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194348:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194368:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90b4909bd200) 00010000:00010000:3.0:1789129196.194371:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129196.194374:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194381:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194414:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4593 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8ba expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194425:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b300) 00010000:00010000:3.0:1789129196.194428:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129196.194432:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8ba expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.194648:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2000, rc 0) 00000100:00100000:3.0:1789129196.194734:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:10492:x1876037604505216:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1030us (1268us total) trans 0 rc 301/301 00000100:00100000:3.0:1789129196.194743:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789129196.202781:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129196.202907:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604505472 00000100:00100000:0.0:1789129196.202918:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604505472 00000100:00100000:0.0:1789129196.202981:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1789129196.202992:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382100f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:10492:x1876037604505472:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:0.0:1789129196.203065:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129196.203100:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce454d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8a5 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.203128:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b300) 00010000:00010000:0.0:1789129196.203150:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129196.203510:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce45a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.203526:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce45a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.203537:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce45a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.203561:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.203568:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.203575:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129196.206267:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1789129196.226119:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce45a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.226150:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce45a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.226158:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce45a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.226163:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129196.226168:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce45a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.226176:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce45a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.226197:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789129196.226200:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129196.226205:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce45a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.226211:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce45a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129196.226235:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000016345aab reply state 0000000091467df5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129196.226244:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789129196.226423:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382100f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:10492:x1876037604505472:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 23429us (23657us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789129196.226448:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00010000:00010000:3.0:1789129196.229980:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.229998:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.230006:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.230020:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129196.230025:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.230033:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.230051:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90b4976b8300) 00010000:00010000:3.0:1789129196.230065:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129196.230070:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.230077:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce45af lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129196.360230:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129196.360426:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604505600 00000100:00100000:1.0:1789129196.360440:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604505600 00000100:00100000:1.0:1789129196.360527:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:1.0:1789129196.360538:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:10500:x1876037604505600:12345-192.168.201.39@tcp:101:lctl.0 00010000:00010000:1.0:1789129196.360565:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129196.360590:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce45b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8c1 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.360683:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce45bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.360698:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce45bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.360713:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce45bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129196.361004:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789129196.361008:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129196.361189:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce45bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.361219:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce45b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8c1 expref: 11 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.361256:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce45bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8c1 expref: 10 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.361948:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:1.0:1789129196.361957:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789129196.361962:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657600, rc 0) 00000100:00100000:1.0:1789129196.362053:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:10500:x1876037604505600:12345-192.168.201.39@tcp:101:lctl.0 Request processed in 1514us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129196.362062:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000001:00080000:1.0:1789129196.415213:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:2.0:1789129196.431578:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129196.431845:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604505728 00000100:00100000:3.0:1789129196.431860:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604505728 00000100:00100000:3.0:1789129196.432021:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:3.0:1789129196.432037:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:10506:x1876037604505728:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129196.432074:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129196.432110:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce45c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8c8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.432210:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.432231:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.432286:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.432307:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce45d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.432315:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.432322:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.432891:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce45d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.432902:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.433183:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129196.433398:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789129196.433404:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129196.433518:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.433538:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.433545:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.433564:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.433570:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129196.433575:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.433584:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.433994:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:3.0:1789129196.434000:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129196.434009:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434017:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce45cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434033:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce45d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434040:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce45d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434047:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce45d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434052:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129196.434055:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce45d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434072:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce45d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434082:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff90b4909bd500) 00010000:00010000:3.0:1789129196.434085:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129196.434088:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce45d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434094:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce45d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434142:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce45c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8c8 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434158:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce45d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8c8 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.434166:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129196.434168:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789129196.434171:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3600, rc 0) 00000100:00100000:2.0:1789129196.443180:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:10506:x1876037604505728:12345-192.168.201.39@tcp:101:bash.0 Request processed in 11127us (11602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129196.443197:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:2.0:1789129196.445772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129196.445926:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604505984 00000100:00100000:3.0:1789129196.445939:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604505984 00000100:00100000:3.0:1789129196.446015:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:3.0:1789129196.446026:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:10506:x1876037604505984:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129196.446056:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129196.446095:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce45e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8cf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.446644:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce45e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.446668:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce45e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.446683:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce45e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.446702:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.446709:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.446716:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789129196.447867:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789129196.448308:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448325:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448341:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448396:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce45e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448415:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce45e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448422:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce45e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448429:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129196.448434:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce45e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448442:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce45e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448458:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129196.448461:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129196.448469:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce45e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448476:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce45e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789129196.448493:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000b134fb8 reply state 00000000cddd766d transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129196.448506:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789129196.448556:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce45e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8cf expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448572:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8cf expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.448592:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:3.0:1789129196.448594:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129196.448597:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2600, rc 0) 00000100:00100000:3.0:1789129196.450497:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:10506:x1876037604505984:12345-192.168.201.39@tcp:101:bash.0 Request processed in 4453us (4723us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789129196.450516:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1789129196.464390:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129196.464676:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604506112 00000100:00100000:1.0:1789129196.464695:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604506112 00000100:00100000:1.0:1789129196.464768:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1789129196.464781:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2366:x1876037604506112:12345-192.168.201.39@tcp:8:bash.0 00010000:00080000:1.0:1789129196.464834:0:6689:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:1.0:1789129196.464891:0:6689:0:(genops.c:1385:class_connect()) connect: client 9463e625-4f12-4089-85aa-d90aafb8e5a9, cookie 0x5c74554e47ce4603 00002000:00100000:1.0:1789129196.464911:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9463e625-4f12-4089-85aa-d90aafb8e5a9/ffff90b492734000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789129196.464928:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:1.0:1789129196.465299:0:6689:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789129196.465347:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90b492733000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789129196.465462:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2366:x1876037604506112:12345-192.168.201.39@tcp:8:bash.0 Request processed in 681us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129196.465473:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00010000:00010000:0.0:1789129196.466536:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.466559:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.466569:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.466576:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129196.466582:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.466591:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.466654:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b4909bde00) 00010000:00010000:0.0:1789129196.466659:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129196.466668:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.466676:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce45ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129196.470377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129196.470760:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604506240 00000100:00100000:1.0:1789129196.470791:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604506240 00000100:00100000:1.0:1789129196.470897:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00080000:0.0:1789129196.470988:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129196.471078:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:0:x1876037604506240:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789129196.471109:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129196.471144:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce460a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8d6 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789129196.471182:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129196.471211:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1789129196.471217:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129196.471433:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce460a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8d6 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.471461:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce460a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8d6 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.471479:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656200, rc 0) 00000100:00100000:1.0:1789129196.471559:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:0:x1876037604506240:12345-192.168.201.39@tcp:101:bash.0 Request processed in 486us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129196.471567:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:2.0:1789129196.474988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129196.475096:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604506368 00000100:00100000:3.0:1789129196.475109:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604506368 00000100:00100000:3.0:1789129196.475179:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1789129196.475191:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:10506:x1876037604506368:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129196.475215:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129196.475461:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8dd expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.475503:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce460a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8d6 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.475513:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129196.475518:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129196.475524:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.475567:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce460a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8d6 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.475597:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce460a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8d6 expref: 8 pid: 6686 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129196.476556:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3821012c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876037626567168:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129196.476734:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c31840 going to sleep for 11 seconds 00000100:00100000:3.0:1789129196.490263:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3821012c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876037626567168:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129196.490316:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.490355:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3200, rc 0) 00000100:00100000:2.0:1789129196.490530:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129196.490586:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:10506:x1876037604506368:12345-192.168.201.39@tcp:101:bash.0 Request processed in 15396us (15610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129196.490596:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789129196.490833:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604506496 00000100:00100000:0.0:1789129196.490849:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604506496 00010000:00010000:0.0:1789129196.494830:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce460a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8d6 expref: 8 pid: 6686 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129196.494946:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1789129196.494967:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490369a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604506496:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129196.495355:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129196.495412:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce460a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8d6 expref: 8 pid: 6686 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.495516:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce460a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8d6 expref: 8 pid: 6686 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.495545:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce460a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8d6 expref: 8 pid: 6686 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.495573:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129196.495578:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129196.495588:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.495717:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.495784:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129196.495803:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38274b0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1876037626567296:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789129196.495945:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484c51c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129196.500891:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38274b0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5826:1876037626567296:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789129196.500930:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129196.501259:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490369a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604506496:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 6293us (10719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129196.501273:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:2.0:1789129196.517882:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129196.518679:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604506752 00000100:00100000:3.0:1789129196.518697:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604506752 00000100:00100000:3.0:1789129196.518781:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789129196.518795:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+11:10506:x1876037604506752:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:2.0:1789129196.519790:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:10506:x1876037604506752:12345-192.168.201.39@tcp:35:bash.0 Request processed in 984us (1904us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789129196.519814:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789129196.628335:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129196.628676:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604507008 00000100:00100000:0.0:1789129196.628689:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604507008 00000100:00100000:0.0:1789129196.628764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:0.0:1789129196.628775:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:10516:x1876037604507008:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129196.628802:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129196.628826:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce4618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8e4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129196.628980:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1789129196.630932:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce4618 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8e4 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.630966:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:0.0:1789129196.630969:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129196.630975:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce4618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8e4 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.630993:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363a00, rc 0) 00000100:00100000:0.0:1789129196.632234:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:10516:x1876037604507008:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3452us (3901us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1789129196.632247:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:3.0:1789129196.639187:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129196.639354:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604507264 00000100:00100000:2.0:1789129196.639371:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604507264 00000100:00100000:2.0:1789129196.639483:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789129196.639499:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3821012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:10516:x1876037604507264:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789129196.640015:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3821012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:10516:x1876037604507264:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 518us (846us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789129196.640026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789129196.741130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789129196.741914:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129196.744366:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604507392 00000100:00100000:1.0:1789129196.744386:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604507392 00000100:00100000:1.0:1789129196.744491:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:1.0:1789129196.744504:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:10522:x1876037604507392:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129196.744544:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129196.744587:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8eb expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.744733:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce462d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.744750:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce462d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.744765:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce462d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129196.744840:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1789129196.744846:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129196.744876:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce462d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.744907:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce4626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8eb expref: 16 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.744940:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce462d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8eb expref: 15 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.744949:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789129196.744952:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789129196.744956:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481657200, rc 0) 00000100:00100000:1.0:1789129196.745036:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:10522:x1876037604507392:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 535us (3922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129196.745045:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:3.0:1789129196.749647:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129196.749800:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604507648 00000100:00100000:2.0:1789129196.749814:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604507648 00000100:00100000:2.0:1789129196.749886:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789129196.749909:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382103840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:10522:x1876037604507648:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129196.749940:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129196.749971:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce4634 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8f2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.750118:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce463b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.750137:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce463b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.750151:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce463b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129196.750165:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789129196.750357:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce4634 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8f2 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.750382:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce463b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8f2 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.750392:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:2.0:1789129196.750395:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789129196.750399:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b400, rc 0) 00000100:00100000:2.0:1789129196.750485:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382103840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:10522:x1876037604507648:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 588us (901us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789129196.750493:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:3.0:1789129196.754432:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129196.755730:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129196.756026:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604508032 00000100:00100000:0.0:1789129196.756042:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604508032 00000100:00100000:0.0:1789129196.756136:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:0.0:1789129196.756148:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382101680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:2368:x1876037604508032:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129196.756193:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129196.756241:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce463b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8f2 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.756265:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:0.0:1789129196.756280:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129196.756349:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382101680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:2368:x1876037604508032:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 203us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129196.756358:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:2.0:1789129196.757720:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604507904 00000100:00100000:2.0:1789129196.757746:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604507904 00000100:00100000:2.0:1789129196.757823:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:2.0:1789129196.757835:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3821003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:10522:x1876037604507904:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129196.757867:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129196.757932:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4649 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa8f9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.758056:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4650 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.758075:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.758090:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129196.758106:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789129196.758289:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4649 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8f9 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.758314:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8f9 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.758325:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:2.0:1789129196.758328:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789129196.758333:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151a000, rc 0) 00000100:00100000:2.0:1789129196.758420:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3821003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:10522:x1876037604507904:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 588us (4001us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789129196.758429:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:3.0:1789129196.774328:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129196.774513:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604508160 00000100:00100000:1.0:1789129196.774543:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604508160 00000100:00100000:1.0:1789129196.774663:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1789129196.774676:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604508160:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:1.0:1789129196.774750:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.774778:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.774789:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129196.774794:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789129196.774799:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.774853:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.774872:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 7 pid: 6688 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129196.774891:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382748f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876037626567424:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129196.775035:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484c51d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789129196.783069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129196.783449:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604508288 00000100:00100000:2.0:1789129196.783464:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604508288 00002000:00100000:2.0:1789129196.783537:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff90b4c0b51e00 x1876037604508288/t0(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:422/0 lens 504/0 e 0 to 0 dl 1789129207 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789129196.783552:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c0b51e00 with x1876037604508288 ext(0->12) 00010000:00010000:2.0:1789129196.783574:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 8 pid: 6688 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.783594:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 8 pid: 6688 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789129196.783650:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b4c0b51e00 00000100:00100000:2.0:1789129196.783691:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789129196.783703:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b51e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2370:x1876037604508288:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:1.0:1789129196.784411:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382748f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876037626567424:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129196.784445:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789129196.871073:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00000100:00100000:2.0:1789129196.871927:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b51e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2370:x1876037604508288:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 88218us (88864us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789129196.871942:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00002000:00100000:2.0:1789129196.871961:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff90b4c0b51e00 x1876037604508288/t4294967299(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:422/0 lens 504/448 e 0 to 0 dl 1789129207 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789129196.871974:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4c0b51e00 with x1876037604508288 ext(0->12) 00010000:00010000:2.0:1789129196.871991:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 9 pid: 6688 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.872012:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 9 pid: 6688 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789129196.872021:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b4c0b51e00 00000100:00100000:3.0:1789129196.885512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129196.885671:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604508416 00000100:00100000:0.0:1789129196.885693:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604508416 00010000:00010000:0.0:1789129196.885766:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 9 pid: 6688 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129196.885822:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:0.0:1789129196.885834:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2367:x1876037604508416:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129196.885856:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789129196.885880:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789129196.885883:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789129196 00002000:00010000:0.0:1789129196.885886:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789129196 00002000:00010000:0.0:1789129196.885888:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789129196 00010000:00010000:0.0:1789129196.885895:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 9 pid: 6688 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.885914:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 9 pid: 6688 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.885973:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce4611 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8dd expref: 9 pid: 6688 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.885998:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789129196.886005:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789129196.886011:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.886022:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.886070:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129196.886330:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2367:x1876037604508416:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 496us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129196.886339:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00010000:00010000:1.0:1789129196.886449:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.886462:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.886498:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.886507:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.886516:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.886523:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129196.886528:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.886536:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.886550:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.886574:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006440e42e/0x5c74554e47ce465e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129196.886749:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604508160:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 112075us (112436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129196.886759:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1789129196.893546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129196.893640:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604508672 00000100:00100000:2.0:1789129196.893651:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604508672 00000100:00100000:2.0:1789129196.893719:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:2.0:1789129196.893729:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:10522:x1876037604508672:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:2.0:1789129196.893842:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8f9 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789129196.894367:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1789129196.895361:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789129196.899836:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1789129196.899972:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.899998:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8cf expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.900010:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.900067:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8cf expref: 22 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.900089:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8cf expref: 22 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129196.900108:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b50780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876037626567552:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129196.900244:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789129196.908447:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129196.908564:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604508800 00000100:00100000:1.0:1789129196.908583:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604508800 00010000:00010000:1.0:1789129196.908683:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8cf expref: 23 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129196.908694:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b50780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876037626567552:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129196.908731:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:1.0:1789129196.908743:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:2370:x1876037604508800:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129196.908752:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.908762:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129196.908773:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8cf expref: 23 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.908790:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8cf expref: 23 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.908816:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce45f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8cf expref: 23 pid: 5840 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.908833:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:1.0:1789129196.908838:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.908864:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.908872:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129196.908914:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129196.908983:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac85a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:2370:x1876037604508800:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 242us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129196.908992:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00010000:00010000:3.0:1789129196.909130:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129196.909150:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789129196.913631:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789129196.913906:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1789129196.914034:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b50780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626567680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789129196.914108:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129196.914142:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789129196.915305:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626567680 00000100:00100000:0.0:1789129196.915322:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626567680 00000100:00100000:0.0:1789129196.915398:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789129196.915411:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626567680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789129196.915545:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626567680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 137us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129196.915553:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789129196.916061:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b50780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626567680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789129196.917106:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789129196.917669:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b50780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626567808:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789129196.917761:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129196.917870:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b498b92c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789129196.930565:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626567808 00000100:00100000:0.0:1789129196.930633:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626567808 00000100:00100000:2.0:1789129196.933384:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789129196.933403:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626567808:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789129196.933809:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1876037626567808:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 411us (16048us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789129196.933818:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789129196.934783:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b50780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626567808:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789129196.934897:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1789129196.934957:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.934969:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.934977:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.934984:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129196.934989:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.934998:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.935018:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:0.0:1789129196.935021:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789129196.935027:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129196.935034:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4665 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789129196.935432:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789129196.935833:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789129196.935850:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360033247237ns, next at 361033244384ns, rc = 0 00000001:00080000:0.0:1789129196.935859:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1789129196.935909:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b4909bd600) 00010000:00010000:0.0:1789129196.935931:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789129196.935944:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4650 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8f9 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129196.936382:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+25:10522:x1876037604508672:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 42652us (42844us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789129196.936394:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000020:00080000:0.0:1789129196.936402:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789129196.948344:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129196.948499:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604508928 00000100:00100000:2.0:1789129196.948511:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604508928 00000100:00100000:2.0:1789129196.948654:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:2.0:1789129196.948665:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+25:10522:x1876037604508928:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129196.948693:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129196.948720:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce466c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa900 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.948799:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce466c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa900 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.948815:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce466c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa900 expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129196.948840:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129196.948843:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789129196.948848:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151ac00, rc 0) 00000100:00100000:2.0:1789129196.948943:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:10522:x1876037604508928:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 279us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129196.948952:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789129196.953952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129196.954065:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604509184 00000100:00100000:0.0:1789129196.954079:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604509184 00000100:00100000:0.0:1789129196.954140:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789129196.954154:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a07050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:10522:x1876037604509184:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129196.954474:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a07050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:10522:x1876037604509184:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 322us (536us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789129196.954483:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789129197.075820:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129197.076461:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604509440 00000100:00100000:1.0:1789129197.076472:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604509440 00000100:00100000:1.0:1789129197.076543:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789129197.076555:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:10532:x1876037604509440:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129197.076581:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129197.076687:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce4673 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa907 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129197.076855:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1789129197.077007:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce4673 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa907 expref: 29 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.077023:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:1.0:1789129197.077026:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789129197.077032:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce4673 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa907 expref: 29 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.077053:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b481656400, rc 0) 00000100:00100000:1.0:1789129197.077144:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:10532:x1876037604509440:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 590us (1336us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1789129197.077161:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:0.0:1789129197.082654:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129197.082836:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604509568 00000100:00100000:2.0:1789129197.082848:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604509568 00000100:00100000:2.0:1789129197.082919:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1789129197.082931:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:10532:x1876037604509568:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789129197.083038:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4681 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083059:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083073:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083090:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4688 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083096:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083102:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083377:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083385:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083392:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789129197.083469:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083483:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4681 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083490:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4681 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083497:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083503:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129197.083508:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4681 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083515:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4681 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083528:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:2.0:1789129197.083531:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129197.083535:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4681 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083541:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4681 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083556:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083561:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4688 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083573:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083579:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129197.083583:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083588:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4688 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083596:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b48544de00) 00010000:00010000:2.0:1789129197.083599:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129197.083946:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4688 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083952:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4688 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083970:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083976:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083981:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.083987:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129197.083990:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.084008:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.084017:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129197.084019:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129197.084023:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.084029:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce468f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129197.084321:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:10532:x1876037604509568:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1387us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129197.084332:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:3.0:1789129197.093821:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129197.093963:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604509824 00000100:00100000:0.0:1789129197.093980:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604509824 00000100:00100000:0.0:1789129197.094049:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789129197.094061:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:10532:x1876037604509824:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129197.098483:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+29:10532:x1876037604509824:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 4408us (4663us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789129197.098501:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1789129197.159429:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129197.159654:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604510080 00000100:00100000:1.0:1789129197.159669:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604510080 00000100:00100000:1.0:1789129197.159754:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:1.0:1789129197.159766:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+29:10535:x1876037604510080:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129197.159806:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129197.159839:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4696 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa90e expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.159963:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce469d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.159984:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce469d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.159998:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce469d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.160016:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce46a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.160024:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.160031:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.165721:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.165756:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.165774:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129197.165799:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789129197.165960:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce469d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.165966:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce469d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.165986:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce469d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.165990:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129197.165993:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce469d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.165998:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce469d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166009:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129197.166012:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129197.166016:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce469d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166020:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656400/0x5c74554e47ce469d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166040:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce46a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166043:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce46a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166047:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce46a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166050:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129197.166052:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce46a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166062:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce46a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166067:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b49117b900) 00010000:00010000:3.0:1789129197.166068:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129197.166070:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce46a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166073:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656200/0x5c74554e47ce46a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166130:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656000/0x5c74554e47ce4696 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa90e expref: 32 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166144:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa90e expref: 31 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.166151:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:3.0:1789129197.166154:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129197.166156:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3000, rc 0) 00000100:00100000:3.0:1789129197.166562:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:10535:x1876037604510080:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 6796us (7149us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789129197.166570:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:1.0:1789129197.171226:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129197.171575:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604510208 00000100:00100000:3.0:1789129197.171589:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604510208 00000100:00100000:3.0:1789129197.171772:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:3.0:1789129197.171785:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:10535:x1876037604510208:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1789129197.171917:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce46b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.172069:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce46b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.172090:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce46b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.172179:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce46b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.172189:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce46b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.172196:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce46b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.172203:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129197.172209:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce46b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.172295:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce46b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.172310:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:3.0:1789129197.172313:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789129197.172319:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce46b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.172327:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce46b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129197.172495:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:10535:x1876037604510208:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 712us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129197.172504:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789129197.175186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129197.175805:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604510464 00000100:00100000:3.0:1789129197.175821:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604510464 00000100:00100000:3.0:1789129197.175948:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:3.0:1789129197.175962:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:10535:x1876037604510464:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129197.176476:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:10535:x1876037604510464:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 515us (1303us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789129197.176485:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1789129197.318446:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626568320:0@lo:400:kworker.0 00000100:00100000:2.0:1789129197.318522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129197.318592:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789129197.318598:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626568192:0@lo:400:kworker.0 00000100:00100000:2.0:1789129197.318647:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129197.318677:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626568320 00000100:00100000:2.0:1789129197.318684:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626568320 00000100:00100000:2.0:1789129197.318816:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626568192 00000100:00100000:2.0:1789129197.318820:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626568192 00000100:00100000:2.0:1789129197.318848:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789129197.318857:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626568320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129197.318911:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626568320:12345-0@lo:400:kworker.0 Request processed in 55us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129197.319069:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626568064:0@lo:400:kworker.0 00000100:00100000:1.0:1789129197.319121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129197.319147:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626568576:0@lo:400:kworker.0 00000100:00100000:1.0:1789129197.319186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129197.319209:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789129197.319215:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626567936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129197.319239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129197.319253:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626568448:0@lo:400:kworker.0 00000100:00100000:1.0:1789129197.319288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129197.319335:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626568064 00000100:00100000:1.0:1789129197.319339:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626568064 00000100:00100000:1.0:1789129197.319366:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789129197.319372:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626568064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129197.319410:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626568064:12345-0@lo:400:kworker.0 Request processed in 38us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129197.319417:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789129197.319446:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626568576 00000100:00100000:1.0:1789129197.319450:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626568576 00000100:00100000:1.0:1789129197.319476:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789129197.319482:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626568576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129197.319513:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626568576:12345-0@lo:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129197.319519:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789129197.319553:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626568064:0@lo:400:kworker.0 00000100:00100000:1.0:1789129197.319566:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626568576:0@lo:400:kworker.0 00000100:00080000:1.0:1789129197.319633:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789129197.319647:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129197.319660:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626568448 00000100:00100000:1.0:1789129197.319665:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626568448 00000100:00100000:1.0:1789129197.319693:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789129197.319699:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626568192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129197.320083:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789129197.320103:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789129197.320111:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626568448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129197.320173:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626568448:12345-0@lo:400:kworker.0 Request processed in 63us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129197.320178:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789129197.320227:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626568320:0@lo:400:kworker.0 00000100:00100000:2.0:1789129197.320254:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626568448:0@lo:400:kworker.0 00000100:00080000:2.0:1789129197.320299:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129197.320498:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626567936 00000100:00100000:0.0:1789129197.320505:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626567936 00000100:00100000:0.0:1789129197.320562:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789129197.320594:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626567936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789129197.320661:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129197.320719:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626567936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129197.320726:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789129197.320862:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626567936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129197.321398:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626568192:12345-0@lo:400:kworker.0 Request processed in 1697us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129197.321409:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789129197.321496:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626568192:0@lo:400:kworker.0 00000100:00100000:0.0:1789129197.537886:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129197.538062:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604510720 00000100:00100000:2.0:1789129197.538074:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604510720 00000100:00100000:2.0:1789129197.538158:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:2.0:1789129197.538169:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:10566:x1876037604510720:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1789129197.538194:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129197.539696:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa915 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.539894:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce46c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.539913:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce46c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.539928:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce46c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129197.539967:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789129197.540155:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa915 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.540176:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce46c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa915 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.540183:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129197.540186:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789129197.540189:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151a000, rc 0) 00000100:00100000:2.0:1789129197.540281:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:10566:x1876037604510720:12345-192.168.201.39@tcp:101:cat.0 Request processed in 2114us (2412us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789129197.540293:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1789129197.544706:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129197.544835:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604510976 00000100:00100000:0.0:1789129197.544850:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604510976 00000100:00100000:0.0:1789129197.544929:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1789129197.544940:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:10566:x1876037604510976:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:0.0:1789129197.545781:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:10566:x1876037604510976:12345-192.168.201.39@tcp:35:cat.0 Request processed in 834us (1087us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789129197.545802:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1789129197.548222:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129197.548588:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604511104 00000100:00100000:0.0:1789129197.548631:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604511104 00000100:00100000:0.0:1789129197.548730:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1789129197.548742:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:2370:x1876037604511104:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129197.548766:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129197.548813:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce46c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa915 expref: 35 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.548839:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:0.0:1789129197.548845:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129197.548917:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:2370:x1876037604511104:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 177us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129197.548940:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:3.0:1789129197.611108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129197.611279:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604511360 00000100:00100000:0.0:1789129197.611298:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604511360 00000100:00100000:0.0:1789129197.611406:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:0.0:1789129197.611421:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:10573:x1876037604511360:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:0.0:1789129197.611467:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129197.611472:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789129197.611523:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657200/0x5c74554e47ce462d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8eb expref: 34 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.611568:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:0.0:1789129197.611575:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129197.611597:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce46d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa91c expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.612083:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.612134:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa90e expref: 34 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.612147:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.612494:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa90e expref: 34 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.612519:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa90e expref: 34 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129197.612537:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5e940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626568704:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129197.612743:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789129197.615323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129197.615484:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5e940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626568704:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129197.615524:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129197.615707:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604511488 00000100:00100000:0.0:1789129197.615717:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604511488 00010000:00010000:0.0:1789129197.615774:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa90e expref: 35 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129197.616035:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:0.0:1789129197.616046:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:2370:x1876037604511488:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129197.616069:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129197.616077:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa90e expref: 35 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.616092:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa90e expref: 35 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.616122:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce46ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa90e expref: 35 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.616141:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:0.0:1789129197.616147:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.616159:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.616169:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129197.616227:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789129197.616233:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.616241:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129197.616272:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:0.0:1789129197.616450:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:2370:x1876037604511488:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 404us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129197.616459:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00010000:00010000:3.0:1789129197.616500:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce46d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa91c expref: 35 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.616518:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa91c expref: 34 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.616537:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:3.0:1789129197.616539:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789129197.616542:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362000, rc 0) 00000100:00100000:3.0:1789129197.616569:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:10573:x1876037604511360:12345-192.168.201.39@tcp:101:dd.0 Request processed in 5152us (5491us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789129197.616576:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:3.0:1789129197.619538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129197.619669:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604511744 00000100:00100000:2.0:1789129197.619684:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604511744 00000100:00100000:2.0:1789129197.619805:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:2.0:1789129197.619818:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:10573:x1876037604511744:12345-192.168.201.39@tcp:36:dd.0 00010000:00010000:2.0:1789129197.620174:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.620196:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.620324:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789129197.620388:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789129197.620432:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ef8a2036 reply state 0000000027bf932d transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129197.620440:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129197.620546:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:10573:x1876037604511744:12345-192.168.201.39@tcp:36:dd.0 Request processed in 730us (1019us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789129197.620554:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000020:00080000:2.0:1789129197.620562:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789129197.626056:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.626084:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.626093:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.626100:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129197.626106:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.626116:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.626141:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:3.0:1789129197.626144:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129197.626150:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.626157:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce46ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129197.770197:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129197.949055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129197.949273:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604511872 00000100:00100000:1.0:1789129197.949356:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604511872 00000100:00100000:1.0:1789129197.949563:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:1.0:1789129197.949575:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+36:10587:x1876037604511872:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:1.0:1789129197.949645:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129197.949671:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce46f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa923 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.949752:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce46f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.949783:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce46f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.949798:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce46f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.949815:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce46ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.949822:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce46ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.949828:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce46ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.949945:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.949957:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa91c expref: 37 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.949966:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.950004:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa91c expref: 37 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.950018:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa91c expref: 37 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129197.950046:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626568832:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129197.950164:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bbef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789129197.953806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129197.953909:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604512128 00000100:00100000:2.0:1789129197.953930:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626568832:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129197.953974:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129197.954430:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604512128 00000100:00100000:3.0:1789129197.954545:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1789129197.954556:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:5609:x1876037604512128:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789129197.954968:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+39:5609:x1876037604512128:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 413us (1174us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789129197.954976:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1789129197.960089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129197.960731:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604512256 00000100:00100000:2.0:1789129197.960745:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604512256 00010000:00010000:2.0:1789129197.960800:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa91c expref: 39 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129197.960850:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:2.0:1789129197.960862:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+39:2369:x1876037604512256:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129197.960892:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129197.960904:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa91c expref: 39 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.961792:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa91c expref: 39 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.961822:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce46dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa91c expref: 39 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.961862:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129197.961868:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.961890:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.961898:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129197.962086:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129197.962173:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:2369:x1876037604512256:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1313us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129197.962192:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00010000:00010000:1.0:1789129197.965503:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.965522:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129197.965725:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789129197.965731:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129197.965791:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.965811:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.965824:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce46f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.965831:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce46f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.965839:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce46f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.965846:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129197.965850:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce46f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.965891:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce46f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.965909:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789129197.966056:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129197.966062:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce46f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966069:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce46f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966089:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce46ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966095:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce46ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966101:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce46ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966106:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129197.966109:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce46ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966114:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce46ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966134:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b49117b100) 00010000:00010000:1.0:1789129197.966138:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129197.966141:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce46ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966157:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce46ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966508:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce46f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa923 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966766:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa923 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129197.966777:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:1.0:1789129197.966780:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789129197.966783:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87c00, rc 0) 00000100:00100000:1.0:1789129197.967022:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:10587:x1876037604511872:12345-192.168.201.39@tcp:101:stat.0 Request processed in 17446us (17977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129197.967033:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:0.0:1789129198.107522:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.107712:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604512512 00000100:00100000:2.0:1789129198.107725:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604512512 00000100:00100000:2.0:1789129198.107888:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:2.0:1789129198.107901:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:10593:x1876037604512512:12345-192.168.201.39@tcp:36:truncate.0 00010000:00010000:2.0:1789129198.107972:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129198.108002:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa923 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.108022:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129198.108027:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789129198.108306:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.108321:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.108348:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789129198.108421:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1789129198.108451:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000980eb53d reply state 00000000fef79d29 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129198.108460:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129198.108596:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+39:10593:x1876037604512512:12345-192.168.201.39@tcp:36:truncate.0 Request processed in 697us (1083us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789129198.108662:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000020:00080000:2.0:1789129198.108668:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789129198.111967:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.111988:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.111996:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.112003:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129198.112009:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.112018:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.112034:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:0.0:1789129198.112038:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129198.112043:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.112051:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce470d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789129198.112899:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129198.363274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129198.363507:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604512640 00000100:00100000:3.0:1789129198.363518:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604512640 00000100:00100000:3.0:1789129198.363585:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:3.0:1789129198.363595:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:10607:x1876037604512640:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:3.0:1789129198.363651:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129198.363676:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa92a expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.363777:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce471b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.363792:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce471b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.363803:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce471b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.363818:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.363835:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.363842:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.363937:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.363944:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.363951:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129198.363987:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789129198.363992:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129198.364014:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364026:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364035:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce471b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364041:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce471b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364048:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce471b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364063:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129198.364068:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce471b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364075:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce471b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364087:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129198.364090:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129198.364095:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce471b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364102:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce471b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364115:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364121:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364127:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364133:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129198.364136:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364141:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364156:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b4909bd900) 00010000:00010000:3.0:1789129198.364158:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129198.364161:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4722 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364167:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364689:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa92a expref: 40 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364710:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa92a expref: 39 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.364716:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:3.0:1789129198.364718:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129198.364721:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2000, rc 0) 00000100:00100000:3.0:1789129198.364841:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+39:10607:x1876037604512640:12345-192.168.201.39@tcp:101:stat.0 Request processed in 1247us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129198.364849:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:2.0:1789129198.461728:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129198.462106:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604512896 00000100:00100000:0.0:1789129198.462121:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604512896 00000100:00100000:0.0:1789129198.462206:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1789129198.462218:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+39:10617:x1876037604512896:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129198.462250:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129198.462342:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4730 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa931 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129198.462487:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1789129198.462710:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4730 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa931 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.462727:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:0.0:1789129198.462730:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129198.462735:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4730 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa931 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.462752:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:0.0:1789129198.462828:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+40:10617:x1876037604512896:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 612us (1117us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1789129198.462836:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1789129198.466438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.466652:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604513152 00000100:00100000:2.0:1789129198.466662:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604513152 00000100:00100000:2.0:1789129198.466721:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:2.0:1789129198.466732:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382101680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+40:10617:x1876037604513152:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789129198.467022:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382101680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+41:10617:x1876037604513152:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 291us (592us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789129198.467030:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789129198.514139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.514442:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604513408 00000100:00100000:2.0:1789129198.514458:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604513408 00000100:00100000:2.0:1789129198.514551:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1789129198.514565:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+41:10623:x1876037604513408:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789129198.514659:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129198.514697:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce473e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa938 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.514854:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.514885:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa92a expref: 42 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.514897:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.514947:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa92a expref: 42 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.514966:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa92a expref: 42 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129198.514985:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902f9680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626568960:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129198.515108:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789129198.520529:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902f9680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626568960:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129198.520577:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129198.522063:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129198.522447:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604513536 00000100:00100000:0.0:1789129198.522460:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604513536 00010000:00010000:0.0:1789129198.522522:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa92a expref: 43 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129198.522584:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:0.0:1789129198.522597:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+43:2369:x1876037604513536:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129198.522678:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129198.522687:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa92a expref: 43 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.522735:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa92a expref: 43 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.522772:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4729 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa92a expref: 43 pid: 6710 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.522794:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:0.0:1789129198.522800:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.522812:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.522822:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.522853:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129198.522945:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+42:2369:x1876037604513536:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 348us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129198.522955:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00010000:00010000:1.0:1789129198.523035:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.523045:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129198.523070:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789129198.523303:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce473e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa938 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.523340:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa938 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.523348:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:1.0:1789129198.523351:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789129198.523354:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b48151b800, rc 0) 00000100:00100000:1.0:1789129198.523387:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+42:10623:x1876037604513408:12345-192.168.201.39@tcp:101:bash.0 Request processed in 8825us (9263us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789129198.523395:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1789129198.528727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.528959:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604513792 00000100:00100000:2.0:1789129198.528973:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604513792 00000100:00100000:2.0:1789129198.529045:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:2.0:1789129198.529057:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3821012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+42:10623:x1876037604513792:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:2.0:1789129198.529418:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.529454:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.529468:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789129198.529520:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789129198.529539:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f8b4d8fc reply state 000000003e062cf1 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129198.529549:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129198.529700:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3821012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:10623:x1876037604513792:12345-192.168.201.39@tcp:36:bash.0 Request processed in 643us (991us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789129198.529708:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000020:00080000:2.0:1789129198.529714:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789129198.531975:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.531998:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.532008:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.532038:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129198.532044:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.532053:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.532077:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:0.0:1789129198.532081:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129198.532087:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.532094:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4753 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129198.536576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129198.537318:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604513920 00000100:00100000:3.0:1789129198.537335:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604513920 00000100:00100000:3.0:1789129198.537424:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:3.0:1789129198.537438:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+44:10623:x1876037604513920:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129198.537476:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129198.537511:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce475a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa93f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.537679:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.537698:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa938 expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.537709:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.537757:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa938 expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.537775:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa938 expref: 45 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129198.537803:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b21680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626569088:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129198.538170:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b498b92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789129198.540522:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b21680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626569088:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129198.540566:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129198.544723:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129198.545163:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604514048 00000100:00100000:1.0:1789129198.545178:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604514048 00010000:00010000:1.0:1789129198.545265:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa938 expref: 46 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129198.545321:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789129198.545333:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+46:2370:x1876037604514048:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129198.545352:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129198.545359:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa938 expref: 46 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.545376:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa938 expref: 46 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.545426:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4745 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa938 expref: 46 pid: 5842 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.545447:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:1.0:1789129198.545453:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.545464:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.545472:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.545566:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129198.545699:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:2370:x1876037604514048:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 367us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129198.545707:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00010000:00010000:3.0:1789129198.547504:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129198.547523:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129198.547777:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789129198.547783:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129198.548052:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.548107:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce475a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa93f expref: 45 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.548131:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa93f expref: 44 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.548140:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129198.548143:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789129198.548147:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3000, rc 0) 00000100:00100000:2.0:1789129198.548392:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+44:10623:x1876037604513920:12345-192.168.201.39@tcp:101:bash.0 Request processed in 10955us (11830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129198.548405:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:0.0:1789129198.552234:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.552358:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604514304 00000100:00100000:2.0:1789129198.552371:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604514304 00000100:00100000:2.0:1789129198.552445:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789129198.552458:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+44:10623:x1876037604514304:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:2.0:1789129198.553029:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:10623:x1876037604514304:12345-192.168.201.39@tcp:35:bash.0 Request processed in 569us (804us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789129198.553040:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789129198.628262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129198.628439:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604514560 00000100:00100000:0.0:1789129198.628454:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604514560 00000100:00100000:0.0:1789129198.628546:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:0.0:1789129198.628561:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:10633:x1876037604514560:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129198.628647:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129198.628694:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4768 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa946 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129198.628886:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1789129198.629063:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4768 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa946 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.629105:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:0.0:1789129198.629108:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129198.629115:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa946 expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129198.629135:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363000, rc 0) 00000100:00100000:0.0:1789129198.629249:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+46:10633:x1876037604514560:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 683us (1007us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789129198.629258:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1789129198.633309:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.633428:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604514688 00000100:00100000:2.0:1789129198.633443:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604514688 00000100:00100000:2.0:1789129198.633528:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:2.0:1789129198.633542:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+46:10633:x1876037604514688:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789129198.633728:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4776 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.633753:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4776 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.633770:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4776 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.633788:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce477d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.633796:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce477d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.633825:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce477d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.633989:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.633999:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634008:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789129198.634070:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634087:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4776 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634095:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4776 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634104:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4776 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634111:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129198.634116:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4776 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634125:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4776 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634142:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:2.0:1789129198.634151:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129198.634157:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634165:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634187:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce477d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634193:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce477d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634200:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce477d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634205:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129198.634208:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce477d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634215:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce477d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634222:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b48544de00) 00010000:00010000:2.0:1789129198.634225:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129198.634228:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce477d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634234:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce477d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634268:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634286:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634291:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634296:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129198.634299:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634304:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634311:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129198.634314:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129198.634317:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.634322:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce4784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129198.634458:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+46:10633:x1876037604514688:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 915us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129198.634470:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:2.0:1789129198.638389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129198.638520:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604514944 00000100:00100000:3.0:1789129198.638540:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604514944 00000100:00100000:3.0:1789129198.638672:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:3.0:1789129198.638686:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+46:10633:x1876037604514944:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129198.639119:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+47:10633:x1876037604514944:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 435us (750us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789129198.639129:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1789129198.685917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.686098:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604515200 00000100:00100000:2.0:1789129198.686113:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604515200 00000100:00100000:2.0:1789129198.686202:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:2.0:1789129198.686216:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+47:10636:x1876037604515200:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129198.686276:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129198.686311:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce478b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa94d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686402:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4792 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686422:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686440:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686462:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686470:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686478:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686733:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce47a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686744:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce47a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686751:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce47a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129198.686764:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789129198.686922:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4792 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686931:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4792 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686939:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4792 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686946:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129198.686952:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4792 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686961:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4792 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.686981:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:2.0:1789129198.686985:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129198.686994:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687001:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151a000/0x5c74554e47ce4792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687023:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687030:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4799 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687036:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687042:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129198.687052:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687059:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4799 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687067:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b48544de00) 00010000:00010000:2.0:1789129198.687070:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129198.687074:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4799 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687080:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b400/0x5c74554e47ce4799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687130:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151b800/0x5c74554e47ce478b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa94d expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687144:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce47a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa94d expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.687151:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129198.687154:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789129198.687156:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea000, rc 0) 00000100:00100000:2.0:1789129198.687282:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:10636:x1876037604515200:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1068us (1385us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789129198.687292:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1789129198.693140:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.693264:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604515328 00000100:00100000:2.0:1789129198.693283:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604515328 00000100:00100000:2.0:1789129198.693370:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:2.0:1789129198.693384:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:10636:x1876037604515328:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:2.0:1789129198.693522:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.693551:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.693567:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.693634:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.693644:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.693653:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.693661:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129198.693668:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.693678:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.693694:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129198.693698:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789129198.693704:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.693711:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129198.693830:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:10636:x1876037604515328:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 448us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129198.693839:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:0.0:1789129198.695309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129198.695416:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604515456 00000100:00100000:1.0:1789129198.695430:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604515456 00000100:00100000:1.0:1789129198.695509:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:1.0:1789129198.695522:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:2369:x1876037604515456:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129198.695545:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129198.695584:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea000/0x5c74554e47ce47a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa94d expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.695692:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:1.0:1789129198.695700:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129198.695771:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+48:2369:x1876037604515456:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 250us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129198.695785:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:2.0:1789129198.698251:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129198.698454:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604515712 00000100:00100000:3.0:1789129198.698470:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604515712 00000100:00100000:3.0:1789129198.698545:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1789129198.698556:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382101680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+48:10636:x1876037604515712:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129198.698975:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382101680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:10636:x1876037604515712:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 418us (742us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789129198.698986:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00010000:00010000:0.0:1789129198.791703:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129198.851414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.851652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604515968 00000100:00100000:2.0:1789129198.851668:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604515968 00000100:00100000:2.0:1789129198.851754:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:2.0:1789129198.851767:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:10654:x1876037604515968:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:2.0:1789129198.851814:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129198.851848:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa954 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.852023:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce47bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.852059:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce47bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.852080:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce47bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129198.852096:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789129198.852296:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa954 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.852321:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce47bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa954 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.852346:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129198.852349:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789129198.853133:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb600, rc 0) 00000100:00100000:2.0:1789129198.853435:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:10654:x1876037604515968:12345-192.168.201.39@tcp:101:cat.0 Request processed in 1667us (2036us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789129198.853448:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:1.0:1789129198.894673:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.894814:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604516096 00000100:00100000:2.0:1789129198.894826:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604516096 00000100:00100000:2.0:1789129198.894915:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:2.0:1789129198.894930:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:10655:x1876037604516096:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129198.894964:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129198.894995:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa95b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.895098:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce47d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.895116:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce47d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.895131:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce47d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129198.895228:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1789129198.895242:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129198.895271:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce47d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.895334:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa95b expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.895369:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce47d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa95b expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.895380:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:2.0:1789129198.895383:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789129198.895388:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb200, rc 0) 00000100:00100000:2.0:1789129198.895473:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:10655:x1876037604516096:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 546us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129198.895482:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789129198.901901:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129198.902082:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604516480 00000100:00100000:0.0:1789129198.902096:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604516480 00000100:00100000:0.0:1789129198.902169:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1789129198.902194:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:10655:x1876037604516480:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129198.902711:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:10655:x1876037604516480:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 526us (821us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789129198.902722:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1789129198.907970:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129198.908255:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604516608 00000100:00100000:1.0:1789129198.908273:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604516608 00000100:00100000:1.0:1789129198.908520:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1789129198.908542:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c51a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:10655:x1876037604516608:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:1.0:1789129198.908573:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789129198.908687:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4761 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa93f expref: 53 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.908719:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce47bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa954 expref: 52 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.908733:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b48151ac00/0x5c74554e47ce466c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa900 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129198.908746:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544d300) 00010000:00010000:1.0:1789129198.908761:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129198.908846:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c51a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:10655:x1876037604516608:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 315us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129198.908855:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1789129198.914521:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.914705:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604516736 00000100:00100000:2.0:1789129198.914722:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604516736 00000100:00100000:2.0:1789129198.914810:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1789129198.914824:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:10655:x1876037604516736:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:2.0:1789129198.915004:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47d8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.915026:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.915041:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129198.915749:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789129198.915997:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789129198.916101:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789129198.916266:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:10655:x1876037604516736:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 1440us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129198.916278:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:3.0:1789129198.938735:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129198.944309:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604516864 00000100:00100000:2.0:1789129198.944340:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604516864 00000100:00100000:2.0:1789129198.944636:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:2.0:1789129198.944654:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:10657:x1876037604516864:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129198.944697:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129198.944739:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce47df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa962 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.944836:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce47e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.944858:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce47e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.944886:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce47e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.944908:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce47ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.944916:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce47ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.944923:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce47ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.945098:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.945133:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.945142:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129198.947712:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789129198.947729:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129198.949136:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949172:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949187:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce47e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949195:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce47e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949204:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce47e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949212:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129198.949218:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce47e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949228:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce47e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949263:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:2.0:1789129198.949266:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129198.949300:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce47e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949309:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce47e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949332:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce47ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949339:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce47ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949346:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce47ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949352:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129198.949355:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce47ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949361:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce47ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949370:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b48544da00) 00010000:00010000:2.0:1789129198.949372:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129198.949375:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce47ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949381:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce47ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949444:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce47df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa962 expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949477:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa962 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129198.949486:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544de00) 00010000:00010000:2.0:1789129198.949489:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789129198.949492:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eae00, rc 0) 00000100:00100000:2.0:1789129198.950667:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:10657:x1876037604516864:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 4952us (10885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129198.950690:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:1.0:1789129199.663697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129199.663739:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129199.663759:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129199.663785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129199.663816:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604516992 00000100:00100000:1.0:1789129199.663826:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604516992 00000100:00100000:1.0:1789129199.663878:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 327 00000100:00100000:1.0:1789129199.663887:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604516992:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129199.663963:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604516992:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 75us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129199.663971:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 327 00000100:00100000:1.0:1789129199.664006:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604517248 00000100:00100000:1.0:1789129199.664009:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604517248 00000100:00100000:1.0:1789129199.664043:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:1.0:1789129199.664050:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604517248:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129199.664077:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604517248:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129199.664084:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00080000:1.0:1789129199.664199:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129199.664638:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604517120 00000100:00100000:0.0:1789129199.664644:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604517120 00000100:00100000:0.0:1789129199.664679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604517376 00000100:00100000:0.0:1789129199.664683:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604517376 00000100:00100000:0.0:1789129199.664716:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:0.0:1789129199.664741:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:2370:x1876037604517120:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129199.664785:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:2370:x1876037604517120:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 46us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129199.664792:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:0.0:1789129199.664807:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:0.0:1789129199.664813:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604517376:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129199.664837:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604517376:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129199.664843:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00080000:0.0:1789129199.664910:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789129199.818686:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789129199.878832:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789129199.878862:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789129199.878933:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789129199.878943:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789129199.879182:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b49036a940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626569216:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789129199.879310:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129199.886163:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b49036a940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626569216:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789129199.889874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129199.890106:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604517504 00000100:00100000:3.0:1789129199.890117:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604517504 00000100:00100000:3.0:1789129199.890185:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1789129199.890197:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:10668:x1876037604517504:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789129199.890297:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:10668:x1876037604517504:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 Request processed in 102us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129199.890306:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:1.0:1789129199.905375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129199.905987:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604517632 00000100:00100000:0.0:1789129199.906002:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604517632 00000100:00100000:0.0:1789129199.906091:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:0.0:1789129199.906105:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:10668:x1876037604517632:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789129199.906160:0:5840:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789129199.906436:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:10668:x1876037604517632:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 334us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129199.906445:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:2.0:1789129199.932523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129199.932675:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604517760 00000100:00100000:0.0:1789129199.932689:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604517760 00000100:00100000:0.0:1789129199.932775:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789129199.932788:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:10668:x1876037604517760:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789129199.933806:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce47fb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934187:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce47fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934205:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce47fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934302:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce4802 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934311:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce4802 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934319:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce4802 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934358:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934366:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934373:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129199.934419:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789129199.934425:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789129199.934446:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934461:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce47fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934478:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce47fb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934485:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce47fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934492:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129199.934497:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce47fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934506:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce47fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934521:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:0.0:1789129199.934524:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129199.934530:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce47fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934536:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce47fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934548:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce4802 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934554:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce4802 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934559:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce4802 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934564:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129199.934575:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce4802 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934583:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce4802 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934591:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff90b4976b8c00) 00010000:00010000:0.0:1789129199.934594:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129199.934597:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce4802 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934634:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce4802 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934653:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934659:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934665:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934669:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129199.934672:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934677:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934687:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544de00) 00010000:00010000:0.0:1789129199.934689:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129199.934699:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129199.934704:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129199.938551:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:10668:x1876037604517760:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 5746us (6023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129199.938572:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789129199.969088:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129199.976286:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604518016 00000100:00100000:2.0:1789129199.976311:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604518016 00000100:00100000:3.0:1789129199.977064:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:3.0:1789129199.977082:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:10668:x1876037604518016:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129199.977108:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129199.977143:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4810 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129199.978596:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129199.978658:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129199.978675:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129199.978691:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789129199.978994:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129199.979005:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4817 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129199.979013:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129199.979028:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129199.979033:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129199.979042:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4817 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129199.979062:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544de00) 00010000:00010000:2.0:1789129199.979065:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789129199.979072:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4817 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129199.979078:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129199.979279:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4810 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa969 expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129199.979294:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:1.0:1789129199.979297:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789129199.979302:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4810 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa969 expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129199.979329:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2400, rc 0) 00000100:00100000:1.0:1789129199.979429:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:10668:x1876037604518016:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2350us (10353us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1789129199.979439:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:1.0:1789129199.986200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129199.986300:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604518144 00000100:00100000:3.0:1789129199.986312:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604518144 00000100:00100000:3.0:1789129199.986379:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:3.0:1789129199.986390:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:10668:x1876037604518144:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789129199.986451:0:5842:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789129199.986591:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:10668:x1876037604518144:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 202us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129199.986631:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:3.0:1789129199.993179:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129199.993437:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604518400 00000100:00100000:1.0:1789129199.993450:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604518400 00000100:00100000:1.0:1789129199.993529:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:1.0:1789129199.993538:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:10668:x1876037604518400:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129199.993565:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129199.993569:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789129199.993621:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce47d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa95b expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129199.993654:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789129199.993660:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129199.994072:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4825 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa970 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789129199.998742:0:6710:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1789129199.999138:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce482c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129199.999159:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce482c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129199.999172:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce482c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129199.999293:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4825 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa970 expref: 54 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129199.999314:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce482c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa970 expref: 53 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129199.999323:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b49117b100) 00010000:00010000:1.0:1789129199.999326:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789129199.999329:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87c00, rc 0) 00000100:00100000:1.0:1789129199.999421:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:10668:x1876037604518400:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5883us (6263us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789129199.999433:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:3.0:1789129200.009203:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129200.009270:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604518656 00000100:00100000:3.0:1789129200.009285:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604518656 00000100:00100000:3.0:1789129200.009433:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:3.0:1789129200.009445:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:10668:x1876037604518656:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789129200.009524:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129200.009574:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce482c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa970 expref: 53 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.009630:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b49117b100) 00010000:00010000:3.0:1789129200.009648:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789129200.009683:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce483a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.009701:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce483a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.009714:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce483a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.009774:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4841 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2a4b2bab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.009782:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a4b2bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.009957:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a4b2bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010131:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce483a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010139:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce483a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010147:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce483a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010153:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129200.010159:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce483a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010176:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce483a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010187:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129200.010190:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129200.010196:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce483a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010203:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce483a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010223:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a4b2bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010229:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4841 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a4b2bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010235:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4841 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a4b2bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010240:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129200.010243:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4841 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a4b2bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010250:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4841 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a4b2bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010257:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2a4b2bab (ffff90b4909bd900) 00010000:00010000:3.0:1789129200.010259:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129200.010263:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4841 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2a4b2bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.010278:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4841 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2a4b2bab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129200.010491:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:10668:x1876037604518656:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1045us (1305us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789129200.010502:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00080000:3.0:1789129200.010551:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1789129200.016408:0:12386:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129200.016421:0:12386:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129200.016461:0:12386:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789129200.016470:0:12386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789129200.022492:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.025964:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604518784 00000100:00100000:2.0:1789129200.025985:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604518784 00000100:00100000:3.0:1789129200.026307:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:3.0:1789129200.026323:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:10668:x1876037604518784:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129200.026351:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129200.026391:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4848 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa977 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.026435:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.026449:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.026464:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.026633:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa977 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.026664:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa977 expref: 53 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.026673:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129200.026676:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789129200.026680:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3400, rc 0) 00000100:00100000:3.0:1789129200.026784:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:10668:x1876037604518784:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 465us (4305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129200.026791:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:0.0:1789129200.038255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.038558:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604519040 00000100:00100000:2.0:1789129200.038572:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604519040 00000100:00100000:2.0:1789129200.038659:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:2.0:1789129200.038671:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:10668:x1876037604519040:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789129200.038786:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.038807:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.038820:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129200.039678:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789129200.039693:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363137090191ns, next at 364137086711ns, rc = 0 00000004:00010000:2.0:1789129200.039803:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005d54de16 reply state 000000001ce6cc7b transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.039814:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129200.039968:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10668:x1876037604519040:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1295us (1721us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789129200.039977:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00010000:00010000:0.0:1789129200.045468:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.045492:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:0.0:1789129200.045497:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.045508:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.045517:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129200.045524:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.045534:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.045543:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604519168 00010000:00010000:0.0:1789129200.045557:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b4909bd500) 00000100:00100000:2.0:1789129200.045558:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604519168 00010000:00010000:0.0:1789129200.045563:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789129200.045570:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.045598:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4856 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.045657:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:2.0:1789129200.045672:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:10668:x1876037604519168:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789129200.045709:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129200.045736:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce485d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa97e expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.045814:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce485d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa97e expref: 55 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.045827:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce485d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa97e expref: 55 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.045845:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789129200.045848:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789129200.045858:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ebc00, rc 0) 00000100:00100000:2.0:1789129200.045932:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10668:x1876037604519168:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 261us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129200.045940:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:2.0:1789129200.062472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129200.062721:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604519296 00000100:00100000:3.0:1789129200.062736:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604519296 00000100:00100000:3.0:1789129200.062791:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:3.0:1789129200.062804:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2366:x1876037604519296:12345-192.168.201.39@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789129200.062851:0:6689:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp t0 exp 0000000000000000 cur 363 last 0 00000020:00000080:3.0:1789129200.062906:0:6689:0:(genops.c:1385:class_connect()) connect: client 9463e625-4f12-4089-85aa-d90aafb8e5a9, cookie 0x5c74554e47ce4864 00002000:00100000:3.0:1789129200.062924:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9463e625-4f12-4089-85aa-d90aafb8e5a9/ffff90b4a77ea000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789129200.062955:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:3.0:1789129200.065785:0:6689:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789129200.065861:0:6689:0:(import.c:65:import_set_state_nolock()) ffff90b4a77ec800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789129200.065988:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b50b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2366:x1876037604519296:12345-192.168.201.39@tcp:8:lhsmtool_posix.0 Request processed in 3185us (3525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129200.066002:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:0.0:1789129200.070420:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129200.070498:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604519424 00000100:00100000:1.0:1789129200.070509:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604519424 00000100:00100000:1.0:1789129200.070593:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1789129200.070632:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:0:x1876037604519424:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789129200.072384:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789129200.127471:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:0:x1876037604519424:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 56854us (57049us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789129200.127488:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000001:00080000:0.0:1789129200.129474:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1789129200.129501:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00000100:00100000:0.0:1789129200.135941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.136281:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604519680 00000100:00100000:2.0:1789129200.136294:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604519680 00000100:00100000:2.0:1789129200.136368:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:2.0:1789129200.136380:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10668:x1876037604519680:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789129200.136724:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:10668:x1876037604519680:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 346us (797us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789129200.136733:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789129200.154217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129200.154376:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604519936 00000100:00100000:3.0:1789129200.154405:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604519936 00000100:00100000:3.0:1789129200.154477:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:3.0:1789129200.154491:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:10668:x1876037604519936:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789129200.154670:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:10668:x1876037604519936:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 181us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129200.154678:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789129200.161481:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129200.161675:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604520064 00000100:00100000:1.0:1789129200.161692:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604520064 00000100:00100000:1.0:1789129200.161778:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:1.0:1789129200.161804:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:10668:x1876037604520064:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129200.161835:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129200.161880:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce486b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa985 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.162009:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce4872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.162027:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce4872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.162041:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce4872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129200.162090:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129200.162116:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce4872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.162150:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce486b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa985 expref: 58 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.162172:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce4872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa985 expref: 57 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.162182:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789129200.162185:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789129200.162190:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87e00, rc 0) 00000100:00100000:1.0:1789129200.162282:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:10668:x1876037604520064:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 493us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129200.162292:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:1.0:1789129200.172403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129200.172975:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604520192 00000100:00100000:3.0:1789129200.173113:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604520192 00000100:00100000:3.0:1789129200.173271:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:3.0:1789129200.173283:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2370:x1876037604520192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129200.173303:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129200.173334:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4879 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa98c expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789129200.173367:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f1ef, blocks: 0x1 00010000:00010000:3.0:1789129200.173391:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1789129200.173398:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129200.173411:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4879 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa98c expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.173437:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4879 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa98c expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.173454:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3800, rc 0) 00000100:00100000:3.0:1789129200.173625:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604520192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 323us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129200.173645:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:3.0:1789129200.177470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129200.177583:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604520448 00000100:00100000:0.0:1789129200.177618:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604520448 00000100:00100000:0.0:1789129200.177698:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:0.0:1789129200.177711:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:10668:x1876037604520448:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789129200.177869:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:10668:x1876037604520448:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 159us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129200.177877:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:0.0:1789129200.183063:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.184495:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604520576 00000100:00100000:2.0:1789129200.184516:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604520576 00000100:00100000:2.0:1789129200.184590:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1789129200.184628:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:10668:x1876037604520576:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789129200.184657:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129200.184685:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa993 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.184723:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4879 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa98c expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.184745:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129200.184751:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129200.184757:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.184800:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4879 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa98c expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.184814:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4879 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa98c expref: 7 pid: 6689 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.184831:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b53c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876037626569344:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129200.184973:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129200.189884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.189914:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b53c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876037626569344:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129200.189959:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.189984:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb400, rc 0) 00000100:00100000:2.0:1789129200.190058:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:10668:x1876037604520576:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5460us (7005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129200.190068:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1789129200.190146:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604520704 00000100:00100000:0.0:1789129200.190155:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604520704 00010000:00010000:0.0:1789129200.190195:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4879 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa98c expref: 7 pid: 6689 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129200.190238:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:0.0:1789129200.190247:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604520704:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129200.190259:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129200.190284:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4879 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa98c expref: 7 pid: 6689 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.190313:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4879 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa98c expref: 7 pid: 6689 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.190346:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4879 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa98c expref: 7 pid: 6689 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.190365:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129200.190369:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129200.190377:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.190387:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.190421:0:8444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129200.190436:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c50000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1876037626569472:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789129200.190506:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483013900 going to sleep for 11 seconds 00000100:00100000:1.0:1789129200.204557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129200.207078:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c50000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1876037626569472:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789129200.207111:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129200.207249:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604520704:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 17002us (17375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129200.207262:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1789129200.207443:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604520832 00000100:00100000:2.0:1789129200.207453:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604520832 00002000:00100000:2.0:1789129200.207502:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff90b4b5b93480 x1876037604520832/t0(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:426/0 lens 504/0 e 0 to 0 dl 1789129211 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789129200.207520:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4b5b93480 with x1876037604520832 ext(0->8) 00002000:00010000:2.0:1789129200.207525:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4b5b93480 00000100:00100000:2.0:1789129200.207557:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789129200.207567:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604520832:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789129200.216977:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604520832:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 9402us (12421us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789129200.217502:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00002000:00100000:2.0:1789129200.217518:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff90b4b5b93480 x1876037604520832/t4294967302(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:426/0 lens 504/448 e 0 to 0 dl 1789129211 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789129200.217529:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4b5b93480 with x1876037604520832 ext(0->8) 00002000:00010000:2.0:1789129200.217537:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4b5b93480 00000100:00100000:1.0:1789129200.232541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.232660:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604520960 00000100:00100000:2.0:1789129200.232671:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604520960 00000100:00100000:2.0:1789129200.232737:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:2.0:1789129200.232750:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:10668:x1876037604520960:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789129200.324965:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:1.0:1789129200.325010:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789129200.325223:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626569600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789129200.325327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129200.325418:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626569600 00000100:00100000:1.0:1789129200.325426:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626569600 00000100:00100000:1.0:1789129200.325478:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789129200.325488:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626569600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789129200.325522:0:6689:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789129200.325570:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3f1ec, atime: 0x6aa3f1ec, ctime: 0x6aa3f1ec, blocks: 0x1 00010000:00010000:1.0:1789129200.325581:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064c55435/0x5c74554e47ce4887 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.325907:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1789129200.325914:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129200.325923:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064c55435/0x5c74554e47ce4887 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.325945:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064c55435/0x5c74554e47ce4887 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.325957:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064c55435/0x5c74554e47ce4887 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.325966:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064c55435/0x5c74554e47ce4887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.326018:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789129200.327073:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129200.327085:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064c55435/0x5c74554e47ce4887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.327099:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129200.327104:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064c55435/0x5c74554e47ce4887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.327130:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064c55435/0x5c74554e47ce4887 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.327154:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064c55435/0x5c74554e47ce4887 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.327161:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064c55435/0x5c74554e47ce4887 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.327188:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129200.327190:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129200.327192:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789129200.327817:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129200.328060:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+48:10668:x1876037604520960:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 95306us (95527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129200.328073:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:1.0:1789129200.330112:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626569600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4613us (4772us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789129200.330129:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000001:00080000:1.0:1789129200.330292:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1789129200.330311:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1789129200.330320:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789129200.330391:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b489c2a240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789129200.330395:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b490146c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b489c2a480 00000020:00080000:1.0:1789129200.330399:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b490146d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4b5b06800 00000020:00080000:1.0:1789129200.330553:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789129200.337295:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1789129200.342495:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626569728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789129200.342645:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789129200.342800:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4b5b93c00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789129200.342809:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626569600:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789129200.343859:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.344015:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626569728 00000100:00100000:2.0:1789129200.344027:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626569728 00000100:00100000:2.0:1789129200.344147:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604521088 00000100:00100000:2.0:1789129200.344151:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604521088 00000100:00100000:2.0:1789129200.344186:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789129200.344198:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626569728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789129200.344451:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789129200.344455:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789129199 00002000:00010000:2.0:1789129200.344458:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789129200.344460:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789129199 -> 1789129199 00002000:00010000:2.0:1789129200.344480:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789129200.344559:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626569728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 363us (1915us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789129200.344567:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789129200.344643:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789129200.344652:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604521088:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1789129200.346924:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4a79f9a40/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789129200.346945:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626569728:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789129200.354198:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789129200.425166:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789129200.425186:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1789129200.425324:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604521088:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 80666us (81465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129200.425335:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:1.0:1789129200.445909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129200.455649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604521344 00000100:00100000:0.0:1789129200.455674:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604521344 00000100:00100000:1.0:1789129200.455841:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:1.0:1789129200.455853:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:10668:x1876037604521344:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789129200.455919:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129200.455949:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce4872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa985 expref: 13 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.455970:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789129200.455976:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129200.456020:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.456034:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.456063:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789129200.456363:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009f3e28dc reply state 00000000b8484af1 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129200.456374:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789129200.457286:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:10668:x1876037604521344:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1426us (11387us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789129200.457304:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:0.0:1789129200.464300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.464910:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604521472 00000100:00100000:2.0:1789129200.464927:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604521472 00000100:00100000:2.0:1789129200.465005:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:2.0:1789129200.465015:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604521472:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789129200.465765:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789129200.465772:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789129199 -> 1789129198 00002000:00010000:2.0:1789129200.465774:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789129196 00002000:00010000:2.0:1789129200.465776:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789129199 -> 1789129198 00002000:00010000:2.0:1789129200.465779:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1789129200.466329:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.466342:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.466349:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.466355:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129200.466360:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.466369:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.466386:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129200.466389:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129200.466393:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.466400:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce488e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.466636:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604521472:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 1578us (2303us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789129200.466650:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:0.0:1789129200.472435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.472619:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604521728 00000100:00100000:2.0:1789129200.472634:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604521728 00000100:00100000:2.0:1789129200.472725:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789129200.472737:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:10668:x1876037604521728:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789129200.472847:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.472870:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa977 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.472879:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.472927:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa977 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.472943:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa977 expref: 13 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.472962:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b53c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626569856:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129200.473063:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789129200.478946:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129200.480042:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604521856 00000100:00100000:3.0:1789129200.480059:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604521856 00010000:00010000:3.0:1789129200.480122:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa977 expref: 14 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129200.480220:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:3.0:1789129200.480232:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2369:x1876037604521856:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129200.480252:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129200.480260:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa977 expref: 14 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.480274:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa977 expref: 14 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.480303:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129200.480308:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.480319:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.480328:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.480355:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129200.480439:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2369:x1876037604521856:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 208us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129200.480447:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00010000:00010000:0.0:1789129200.482709:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce484f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa977 expref: 13 pid: 5840 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129200.482745:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b53c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626569856:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129200.482784:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.483127:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.483136:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.483274:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.483281:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.483288:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.483293:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eba00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129200.483298:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.483307:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.483332:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129200.483335:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789129200.483343:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129200.483350:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4895 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129200.483585:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:10668:x1876037604521728:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 10848us (11159us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789129200.483598:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789129200.487345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129200.487454:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604521984 00000100:00100000:0.0:1789129200.487471:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604521984 00000100:00100000:0.0:1789129200.487770:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789129200.487785:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604521984:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789129200.487874:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.487902:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.487932:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129200.487939:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789129200.487944:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.487993:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.488009:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 7 pid: 6688 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129200.488026:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c51e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876037626569984:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129200.488146:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4812ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129200.491776:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129200.491915:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c51e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876037626569984:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129200.491946:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.492147:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604522112 00000100:00100000:2.0:1789129200.492163:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604522112 00010000:00010000:2.0:1789129200.492214:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 8 pid: 6688 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.492256:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789129200.492267:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2370:x1876037604522112:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129200.492304:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129200.492331:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 8 pid: 6688 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.492346:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 8 pid: 6688 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.492373:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce4880 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa993 expref: 8 pid: 6688 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.492390:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789129200.492394:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789129200.492400:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.492409:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.492434:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129200.492502:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604522112:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 238us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129200.492511:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00010000:00010000:0.0:1789129200.492810:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.492820:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.492864:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.492881:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.492889:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.492897:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129200.492901:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.492909:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.492921:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.492928:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065aacf40/0x5c74554e47ce489c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129200.492987:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604521984:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 5207us (5659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129200.492995:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:3.0:1789129200.500116:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129200.500526:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604522368 00000100:00100000:0.0:1789129200.500541:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604522368 00000100:00100000:0.0:1789129200.500652:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:0.0:1789129200.500683:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:10668:x1876037604522368:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789129200.500800:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce48a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.500822:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce48a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.500848:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce48a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.501554:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.501570:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce485d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa97e expref: 13 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.501579:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.503710:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce485d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa97e expref: 13 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.503737:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce485d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa97e expref: 13 pid: 6710 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129200.503756:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626570112:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129200.503890:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4812ed0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129200.509495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.509666:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604522496 00000100:00100000:2.0:1789129200.509679:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604522496 00010000:00010000:2.0:1789129200.509733:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce485d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa97e expref: 14 pid: 6710 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.509800:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:2.0:1789129200.509812:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2370:x1876037604522496:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129200.509847:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129200.509856:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce485d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa97e expref: 14 pid: 6710 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.509874:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce485d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa97e expref: 14 pid: 6710 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.509909:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789129200.509916:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.509929:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.509939:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.509965:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129200.510044:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2370:x1876037604522496:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 234us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129200.510052:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00010000:00010000:1.0:1789129200.510779:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce485d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa97e expref: 13 pid: 6710 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129200.510806:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626570112:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129200.510858:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.510868:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.510894:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789129200.511197:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1789129200.511391:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789129200.511437:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1789129200.514667:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876037626570240:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789129200.514777:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129200.515067:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626570240 00000100:00100000:2.0:1789129200.515076:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626570240 00000100:00100000:2.0:1789129200.515138:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789129200.515149:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876037626570240:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789129200.515294:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876037626570240:12345-0@lo:1000:mdt00_001.0 Request processed in 146us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129200.515301:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789129200.517000:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482ba53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129200.517090:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789129200.517109:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4a79f9a40, transno 4294967303 00000100:00100000:2.0:1789129200.517141:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876037626570240:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789129200.520065:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789129200.520197:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0e3f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876037626570368:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789129200.520284:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129200.520332:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129200.520757:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626570368 00000100:00100000:1.0:1789129200.520766:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626570368 00000100:00100000:1.0:1789129200.520824:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789129200.520841:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876037626570368:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789129200.521067:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1876037626570368:12345-0@lo:1000:mdt00_001.0 Request processed in 226us (781us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789129200.521076:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789129200.521727:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0e3f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876037626570368:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789129200.521780:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521792:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521800:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521807:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129200.521812:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521819:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521845:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789129200.521863:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789129200.521869:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521875:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce48aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521924:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47d8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521931:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47d8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521937:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521942:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129200.521945:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47d8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521951:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47d8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521959:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544de00) 00010000:00010000:2.0:1789129200.521962:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789129200.521965:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47d8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.521971:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce47d8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.522020:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.522045:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa962 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.522056:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.522103:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa962 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.522123:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa962 expref: 16 pid: 5842 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.522137:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0e3fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626570496:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129200.522266:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789129200.528094:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0e3fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626570496:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129200.528160:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129200.528697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.529121:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604522624 00000100:00100000:2.0:1789129200.529129:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604522624 00010000:00010000:2.0:1789129200.529179:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa962 expref: 17 pid: 5842 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129200.529225:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:2.0:1789129200.529237:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:2369:x1876037604522624:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129200.529254:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129200.529278:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa962 expref: 17 pid: 5842 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.529293:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa962 expref: 17 pid: 5842 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.529318:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce47f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa962 expref: 17 pid: 5842 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.529334:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544de00) 00010000:00010000:2.0:1789129200.529339:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.529349:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.529357:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.529387:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129200.529458:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:2369:x1876037604522624:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 222us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129200.529467:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00010000:00010000:1.0:1789129200.529721:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529729:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529742:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529748:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529754:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529768:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129200.529774:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529782:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529810:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544de00) 00010000:00010000:1.0:1789129200.529813:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129200.529817:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529823:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce48b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529845:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce48a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529851:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce48a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529856:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce48a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529862:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129200.529864:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce48a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529870:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce48a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529890:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544de00) 00010000:00010000:1.0:1789129200.529892:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789129200.529895:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce48a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129200.529900:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce48a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129200.530165:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:10668:x1876037604522368:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 29484us (30077us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789129200.530175:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000020:00080000:1.0:1789129200.530180:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789129200.530643:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789129200.530650:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789129200.530682:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789129200.530690:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789129200.537997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129200.538223:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604522880 00000100:00100000:2.0:1789129200.538236:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604522880 00000100:00100000:2.0:1789129200.538303:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1789129200.538326:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:10668:x1876037604522880:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789129200.539338:0:5843:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789129200.539457:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1789129200.539549:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.539575:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.539590:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.539632:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.539640:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.539648:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129200.539719:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789129200.539876:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:10668:x1876037604522880:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1545us (1887us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789129200.539886:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000020:00080000:2.0:1789129200.539891:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789129200.546782:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129200.546798:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.546809:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129200.546813:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.546824:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.546911:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90b48544db00) 00010000:00010000:0.0:1789129200.546935:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789129200.546943:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.546950:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce48b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129200.546973:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129200.546975:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129200.546977:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129200.839984:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129200.902239:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789129200.902271:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626570624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129200.902359:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129200.902488:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626570624 00000100:00100000:3.0:1789129200.902499:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626570624 00000100:00100000:3.0:1789129200.902567:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789129200.902578:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626570624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129200.902655:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129200.902714:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626570624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129200.902723:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789129200.903000:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626570624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789129201.862126:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789129202.051029:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1789129202.051056:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000040:00080000:3.0:1789129202.212441:0:12441:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129202.212454:0:12441:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129202.212507:0:12441:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789129202.212515:0:12441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789129202.377068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129202.377226:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604523136 00000100:00100000:1.0:1789129202.377240:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604523136 00000100:00100000:1.0:1789129202.377335:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:1.0:1789129202.377347:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:10686:x1876037604523136:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129202.377376:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129202.377407:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa99a expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.377835:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce48c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.377854:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce48c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.377870:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce48c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129202.377892:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1789129202.378103:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa99a expref: 20 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.378275:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce48c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa99a expref: 19 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.378287:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789129202.378290:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789129202.378295:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87e00, rc 0) 00000100:00100000:1.0:1789129202.378375:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:10686:x1876037604523136:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1030us (1319us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1789129202.378383:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00080000:1.0:1789129202.378411:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129202.391438:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129202.391534:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604523264 00000100:00100000:1.0:1789129202.391546:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604523264 00000100:00100000:1.0:1789129202.391648:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:1.0:1789129202.391659:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:10686:x1876037604523264:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789129202.391755:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.391786:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.391798:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.391816:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.391837:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.391844:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392194:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392205:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392212:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789129202.392263:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392277:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392284:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392291:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392297:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.392301:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392309:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392328:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789129202.392330:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129202.392335:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392342:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392356:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392362:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392368:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392373:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.392375:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392381:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392387:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b49117b300) 00010000:00010000:1.0:1789129202.392389:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129202.392392:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392398:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392424:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392429:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392434:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392438:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.392441:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392446:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392454:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b700) 00010000:00010000:1.0:1789129202.392456:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129202.392459:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.392464:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129202.392570:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:10686:x1876037604523264:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 910us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129202.392578:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:0.0:1789129202.438875:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626570752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129202.438971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129202.444445:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626570752 00000100:00100000:3.0:1789129202.444465:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626570752 00000100:00100000:3.0:1789129202.444987:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789129202.445004:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c52d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626570752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789129202.445065:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129202.446949:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c52d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626570752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1939us (7965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129202.446967:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789129202.447028:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789129202.447305:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626570880:0@lo:400:kworker.0 00000100:00100000:1.0:1789129202.447397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129202.447874:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129202.447882:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626571008:0@lo:400:kworker.0 00000100:00100000:1.0:1789129202.447914:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129202.447939:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626570752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129202.447959:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626570880 00000100:00100000:1.0:1789129202.447968:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626570880 00000100:00100000:1.0:1789129202.448020:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789129202.448030:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626570880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129202.448098:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626570880:12345-0@lo:400:kworker.0 Request processed in 69us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129202.448105:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789129202.448140:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626571008 00000100:00100000:1.0:1789129202.448144:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626571008 00000100:00100000:1.0:1789129202.448179:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789129202.448186:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626571008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129202.448217:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626571008:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129202.448222:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789129202.448681:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626571008:0@lo:400:kworker.0 00000100:00100000:3.0:1789129202.448696:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626570880:0@lo:400:kworker.0 00000100:00100000:0.0:1789129202.463773:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129202.463812:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0b53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626571392:0@lo:400:kworker.0 00000100:00100000:0.0:1789129202.463928:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129202.463991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626571392 00000100:00100000:0.0:1789129202.463999:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626571392 00000100:00100000:0.0:1789129202.464070:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789129202.464081:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626571392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129202.464149:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626571392:12345-0@lo:400:kworker.0 Request processed in 68us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129202.464158:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789129202.464227:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0b53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626571392:0@lo:400:kworker.0 00000100:00100000:1.0:1789129202.464324:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626571136:0@lo:400:kworker.0 00000100:00100000:1.0:1789129202.464360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129202.464392:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789129202.464398:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626571264:0@lo:400:kworker.0 00000100:00100000:1.0:1789129202.464431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129202.464466:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626571264 00000100:00100000:1.0:1789129202.464470:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626571264 00000100:00100000:1.0:1789129202.464514:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789129202.464521:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626571264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129202.464564:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626571264:12345-0@lo:400:kworker.0 Request processed in 44us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129202.464581:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789129202.464639:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789129202.464647:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1789129202.464690:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4b5b93c00, transno 4294967301 00000100:00100000:1.0:1789129202.464703:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c51a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626571264:0@lo:400:kworker.0 00000100:00100000:0.0:1789129202.465177:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626571136 00000100:00100000:0.0:1789129202.465183:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626571136 00000100:00100000:0.0:1789129202.465222:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789129202.465229:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626571136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129202.465282:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626571136:12345-0@lo:400:kworker.0 Request processed in 52us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129202.465289:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789129202.465319:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626571136:0@lo:400:kworker.0 00000100:00080000:3.0:1789129202.465650:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789129202.465655:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129202.465935:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129202.465991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604523520 00000100:00100000:1.0:1789129202.465997:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604523520 00000100:00100000:1.0:1789129202.466033:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:1.0:1789129202.466041:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:10689:x1876037604523520:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129202.466055:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129202.466079:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9a1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.466372:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.466429:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.466442:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.466473:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.466482:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.466489:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467272:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467283:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467292:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129202.467316:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789129202.467466:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467475:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467481:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467487:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.467492:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467501:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467515:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789129202.467518:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129202.467525:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467542:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce48f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467572:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467580:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467586:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467591:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.467594:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467639:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467649:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b49117b700) 00010000:00010000:1.0:1789129202.467651:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129202.467654:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467660:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce48f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467714:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce48e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a1 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467727:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a1 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.467741:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:1.0:1789129202.467743:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789129202.467745:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87400, rc 0) 00000100:00100000:1.0:1789129202.468480:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:10689:x1876037604523520:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2435us (2543us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789129202.468491:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:0.0:1789129202.481131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129202.481225:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604523648 00000100:00100000:1.0:1789129202.481240:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604523648 00000100:00100000:1.0:1789129202.481324:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:1.0:1789129202.481337:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:10689:x1876037604523648:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:1.0:1789129202.481440:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce490c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.481465:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce490c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.481481:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce490c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.481520:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce490c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.481526:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce490c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.481533:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce490c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.481540:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.481556:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce490c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.481564:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce490c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.481577:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:1.0:1789129202.481581:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789129202.481587:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce490c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.481594:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce490c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129202.481699:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:10689:x1876037604523648:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 364us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129202.481707:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:1.0:1789129202.499664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129202.499774:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604523904 00000100:00100000:0.0:1789129202.499787:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604523904 00000100:00100000:0.0:1789129202.499867:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:0.0:1789129202.499879:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a04450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:10689:x1876037604523904:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129202.500204:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a04450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:10689:x1876037604523904:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 325us (551us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789129202.500212:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1789129202.544624:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129202.544667:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604524160 00000100:00100000:1.0:1789129202.544678:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604524160 00000100:00100000:1.0:1789129202.544735:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:1.0:1789129202.544747:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:10209:x1876037604524160:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789129202.544780:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129202.545969:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4913 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9a8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.546109:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.547585:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a1 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.547595:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.547676:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a1 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.547695:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a1 expref: 23 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129202.547711:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c53c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626571520:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129202.548991:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789129202.555256:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c53c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626571520:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129202.555292:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129202.556099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129202.556195:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604524288 00000100:00100000:2.0:1789129202.556204:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604524288 00010000:00010000:2.0:1789129202.556248:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a1 expref: 24 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129202.556288:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:2.0:1789129202.556298:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:2369:x1876037604524288:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129202.556315:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129202.556322:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a1 expref: 24 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.556335:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a1 expref: 24 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.556360:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce48fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a1 expref: 24 pid: 5842 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.556375:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:2.0:1789129202.556381:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.556391:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.556400:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.556430:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129202.556487:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:2369:x1876037604524288:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 190us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129202.556509:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00010000:00010000:1.0:1789129202.556921:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.556930:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129202.556952:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789129202.557132:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4913 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a8 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.557162:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a8 expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.557179:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:1.0:1789129202.557182:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789129202.557185:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87a00, rc 0) 00000100:00100000:1.0:1789129202.557221:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:10209:x1876037604524160:12345-192.168.201.39@tcp:101:bash.0 Request processed in 12477us (12629us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789129202.557229:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:3.0:1789129202.565497:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129202.571018:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604524544 00000100:00100000:2.0:1789129202.571041:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604524544 00000100:00100000:2.0:1789129202.571152:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:2.0:1789129202.571176:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:10209:x1876037604524544:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:2.0:1789129202.571519:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.571540:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.571558:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789129202.571639:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789129202.571669:0:6710:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009079376f reply state 000000005c1bf364 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129202.571680:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789129202.571786:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789129202.571952:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:10209:x1876037604524544:12345-192.168.201.39@tcp:36:bash.0 Request processed in 788us (6471us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789129202.571962:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000020:00080000:2.0:1789129202.571970:0:6710:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789129202.581247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789129202.581300:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.581313:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.581333:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.581339:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129202.581344:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.581352:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.581369:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:2.0:1789129202.581372:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129202.581377:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129202.581383:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4928 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129202.582733:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604524672 00000100:00100000:0.0:1789129202.582748:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604524672 00000100:00100000:0.0:1789129202.582824:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:0.0:1789129202.582837:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:10209:x1876037604524672:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789129202.582866:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129202.582892:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce492f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9af expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129202.582960:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce492f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9af expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129202.582974:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce492f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9af expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129202.583013:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:0.0:1789129202.583016:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129202.583020:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362800, rc 0) 00000100:00100000:0.0:1789129202.583090:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:10209:x1876037604524672:12345-192.168.201.39@tcp:101:bash.0 Request processed in 256us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129202.583098:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789129202.587095:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129202.587266:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604524800 00000100:00100000:0.0:1789129202.587277:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604524800 00000100:00100000:0.0:1789129202.587350:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:0.0:1789129202.587362:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:10209:x1876037604524800:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789129202.587381:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129202.587404:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce4936 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9b6 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789129202.587434:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3f1ee, atime: 0x6aa3f1ec, ctime: 0x6aa3f1ee, blocks: 0xb 00010000:00010000:0.0:1789129202.587461:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1789129202.587466:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129202.587476:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce4936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9b6 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129202.587497:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce4936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9b6 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129202.587511:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:0.0:1789129202.587575:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5532450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:10209:x1876037604524800:12345-192.168.201.39@tcp:101:bash.0 Request processed in 216us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129202.587626:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00080000:3.0:1789129202.588951:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129202.590855:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129202.590935:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604524928 00000100:00100000:2.0:1789129202.590944:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604524928 00002000:00010000:2.0:1789129202.590995:0:6692:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1789129202.591000:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd8000 with x1876037604524928 ext(0->18446744073709551615) 00002000:00010000:2.0:1789129202.591012:0:6692:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd8000. 00000100:00100000:2.0:1789129202.591047:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:2.0:1789129202.591057:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604524928:12345-192.168.201.39@tcp:10:bash.0 00002000:00010000:2.0:1789129202.591396:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789129202.591400:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789129198 -> 1789129202 00002000:00010000:2.0:1789129202.591418:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789129196 -> 1789129196 00002000:00010000:2.0:1789129202.591420:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789129198 -> 1789129202 00002000:00010000:2.0:1789129202.591423:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789129202.591497:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604524928:12345-192.168.201.39@tcp:10:bash.0 Request processed in 439us (652us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789129202.591506:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00002000:00010000:2.0:1789129202.591509:0:6692:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1789129202.591512:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bfcd8000 with x1876037604524928 ext(0->18446744073709551615) 00002000:00010000:2.0:1789129202.591516:0:6692:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bfcd8000. 00000100:00100000:2.0:1789129202.692520:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129202.692650:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604525056 00000100:00100000:1.0:1789129202.692666:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604525056 00000100:00100000:1.0:1789129202.692754:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:1.0:1789129202.692769:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:10703:x1876037604525056:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789129202.692866:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce493d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.692885:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce493d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.692899:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce493d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.692917:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4944 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.692924:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.692956:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693318:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693329:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693337:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789129202.693385:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693397:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce493d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693404:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce493d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693411:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce493d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693418:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.693423:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce493d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693432:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce493d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693446:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789129202.693456:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129202.693463:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce493d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693471:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce493d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693488:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693494:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4944 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693501:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693506:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.693510:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693517:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4944 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693525:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b49117b700) 00010000:00010000:1.0:1789129202.693528:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129202.693531:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4944 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693537:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4944 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693554:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693566:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693573:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693578:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.693582:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693588:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693597:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:1.0:1789129202.693686:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129202.693691:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.693697:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce494b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129202.693804:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:10703:x1876037604525056:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1036us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129202.693813:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:0.0:1789129202.760744:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129202.760874:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604525312 00000100:00100000:1.0:1789129202.760887:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604525312 00000100:00100000:1.0:1789129202.760980:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:1.0:1789129202.760992:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:10707:x1876037604525312:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129202.761017:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129202.761060:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4952 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9bd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761157:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4959 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761203:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761216:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761233:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761241:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761247:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761693:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4967 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761704:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761711:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129202.761724:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789129202.761821:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4959 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761839:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4959 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761845:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761851:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.761855:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761863:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4959 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761877:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789129202.761880:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129202.761885:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4959 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761891:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4959 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761905:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761911:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761916:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761922:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129202.761931:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761937:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761945:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b49117b700) 00010000:00010000:1.0:1789129202.761948:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129202.761952:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.761958:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.762006:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4952 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9bd expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.762020:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9bd expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.762027:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:1.0:1789129202.762030:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789129202.762034:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86400, rc 0) 00000100:00100000:1.0:1789129202.762114:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+29:10707:x1876037604525312:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1124us (1383us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1789129202.762123:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:3.0:1789129202.769701:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129202.769849:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604525440 00000100:00100000:1.0:1789129202.769870:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604525440 00000100:00100000:1.0:1789129202.769968:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:1.0:1789129202.769981:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+29:10707:x1876037604525440:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:1.0:1789129202.770095:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.770116:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a8 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.770128:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.770184:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a8 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.770199:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a8 expref: 29 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129202.770214:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c51e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626571648:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129202.770337:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789129202.776006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129202.776181:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c51e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626571648:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129202.776216:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129202.776300:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604525696 00000100:00100000:0.0:1789129202.776308:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604525696 00000100:00100000:0.0:1789129202.776371:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789129202.776380:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+30:5609:x1876037604525696:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789129202.776797:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:5609:x1876037604525696:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 416us (803us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789129202.776805:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789129202.780323:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129202.780431:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604525824 00000100:00100000:1.0:1789129202.780443:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604525824 00010000:00010000:1.0:1789129202.780509:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a8 expref: 31 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129202.780559:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:1.0:1789129202.780569:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:2370:x1876037604525824:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129202.780643:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129202.780653:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a8 expref: 31 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.780669:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a8 expref: 31 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.780695:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce491a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9a8 expref: 31 pid: 5840 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.780723:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:1.0:1789129202.780729:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.780739:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.780748:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129202.780784:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129202.780851:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+30:2370:x1876037604525824:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 283us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129202.780858:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00010000:00010000:3.0:1789129202.781122:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.781131:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.781177:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.781185:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.781191:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.781198:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129202.781202:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.781210:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.781219:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:3.0:1789129202.781222:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789129202.781226:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.781244:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129202.781292:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+29:10707:x1876037604525440:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 11312us (11611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129202.781301:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:3.0:1789129202.791455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129202.791657:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604526080 00000100:00100000:0.0:1789129202.791670:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604526080 00000100:00100000:0.0:1789129202.791724:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1789129202.791735:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+29:10707:x1876037604526080:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129202.792046:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+30:10707:x1876037604526080:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 312us (600us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789129202.792056:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00010000:00010000:0.0:1789129202.886020:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129202.917414:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129202.917523:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604526336 00000100:00100000:3.0:1789129202.917535:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604526336 00000100:00100000:3.0:1789129202.917652:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:3.0:1789129202.917664:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+30:10718:x1876037604526336:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:3.0:1789129202.917699:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129202.917731:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce497c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9c4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.917830:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4983 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.917850:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4983 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.917867:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4983 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.917884:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce498a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.917892:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce498a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.917921:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce498a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.918834:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4991 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.918851:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.918862:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129202.918875:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789129202.919009:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4983 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919018:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4983 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919025:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4983 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919031:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129202.919035:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4983 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919044:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4983 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919058:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129202.919062:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129202.919075:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919081:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919095:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce498a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919101:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce498a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919106:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce498a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919722:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129202.919727:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce498a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919736:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce498a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919747:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b4909bd300) 00010000:00010000:3.0:1789129202.919750:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129202.919753:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce498a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919760:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce498a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919833:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce497c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9c4 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919864:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9c4 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129202.919871:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:3.0:1789129202.919874:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129202.919877:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3c00, rc 0) 00000100:00100000:3.0:1789129202.920025:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:10718:x1876037604526336:12345-192.168.201.39@tcp:101:cat.0 Request processed in 2361us (2626us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789129202.920035:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:1.0:1789129202.937667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129202.937840:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604526592 00000100:00100000:0.0:1789129202.937863:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604526592 00000100:00100000:0.0:1789129202.937971:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:0.0:1789129202.937987:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:10718:x1876037604526592:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:0.0:1789129202.938344:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+33:10718:x1876037604526592:12345-192.168.201.39@tcp:35:cat.0 Request processed in 360us (747us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789129202.938375:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:1.0:1789129203.050216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.055876:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604526848 00000100:00100000:2.0:1789129203.055920:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604526848 00000100:00100000:2.0:1789129203.056042:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:2.0:1789129203.056059:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+33:10719:x1876037604526848:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:2.0:1789129203.056359:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789129203.056411:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4991 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9c4 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.056445:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4967 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9bd expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.056464:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce492f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9af expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.056477:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b49117b300) 00010000:00010000:2.0:1789129203.056493:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789129203.056555:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce499f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.056572:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce499f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.056586:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce499f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.056674:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.056683:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.056690:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.064760:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce49ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.065314:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce49ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.065389:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce49ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129203.067764:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1789129203.067782:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366165179443ns, next at 367165175191ns, rc = 0 00010000:00010000:2.0:1789129203.067887:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073721:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073798:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073811:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073818:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073825:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073864:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789129203.073916:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce49ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073924:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce49ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073930:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce49ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073937:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129203.073941:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce49ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073949:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce49ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073964:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544da00) 00010000:00010000:2.0:1789129203.073967:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789129203.073981:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce49ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.073987:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce49ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.074019:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce499f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.074026:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce499f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.074031:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce499f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.074036:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129203.074039:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce499f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.074045:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce499f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.074054:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:2.0:1789129203.074057:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129203.074060:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce499f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.074066:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce499f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789129203.074076:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008189e611 reply state 000000009be2f5d7 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129203.074101:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129203.074450:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:10719:x1876037604526848:12345-192.168.201.39@tcp:36:rm.0 Request processed in 18390us (24243us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789129203.074461:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00010000:00010000:3.0:1789129203.075896:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129203.075923:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.075936:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebe00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129203.075940:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.075950:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.075970:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90b48544da00) 00010000:00010000:3.0:1789129203.075973:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789129203.075978:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.075984:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce49b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.076011:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129203.076030:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129203.076032:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129203.079683:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.079711:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.079720:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.079726:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eba00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129203.079732:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.079741:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.079764:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b48544db00) 00010000:00010000:3.0:1789129203.079767:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129203.079773:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.079779:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce49a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129203.181163:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129203.181408:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604527104 00000100:00100000:0.0:1789129203.181421:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604527104 00000100:00100000:0.0:1789129203.181512:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:0.0:1789129203.181536:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:10725:x1876037604527104:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789129203.181576:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129203.181648:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce49bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9cb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.181828:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce49c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.181849:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce49c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.181868:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce49c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.181886:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.181894:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.182298:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789129203.185849:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789129203.187063:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187102:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187132:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187192:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce49c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187200:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce49c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187209:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce49c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187217:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129203.187221:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce49c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187230:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce49c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187247:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:0.0:1789129203.187251:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129203.187258:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce49c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187266:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363800/0x5c74554e47ce49c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129203.187285:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002234d449 reply state 00000000fbba3c7a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129203.187307:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789129203.187354:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce49bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9cb expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187372:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9cb expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.187382:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789129203.187384:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129203.187387:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362800, rc 0) 00000100:00100000:0.0:1789129203.187526:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:10725:x1876037604527104:12345-192.168.201.39@tcp:101:bash.0 Request processed in 5991us (6385us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789129203.187538:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:1.0:1789129203.198597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129203.199359:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604527232 00000100:00100000:3.0:1789129203.199378:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604527232 00000100:00100000:3.0:1789129203.199503:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1789129203.199526:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2370:x1876037604527232:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129203.199555:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129203.199598:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce49de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9d2 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789129203.199671:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789129203.199701:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=366s v=(0 0) 00010000:00010000:3.0:1789129203.199707:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129203.199721:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce49de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d2 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.199752:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce49de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d2 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.199772:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3200, rc 0) 00000100:00080000:0.0:1789129203.200126:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129203.200689:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604527232:12345-192.168.201.39@tcp:101:bash.0 Request processed in 1162us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129203.200699:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00010000:00010000:2.0:1789129203.200810:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.200822:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.200831:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.200838:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129203.200844:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.200853:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.200872:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b4976b8700) 00010000:00010000:2.0:1789129203.200876:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129203.201061:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.201072:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce49c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129203.207359:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129203.208253:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604527360 00000100:00100000:0.0:1789129203.208273:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604527360 00000100:00100000:0.0:1789129203.208372:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:0.0:1789129203.208385:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:10725:x1876037604527360:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789129203.208418:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129203.208449:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9d9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.208525:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce49de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d2 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.208535:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129203.208561:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129203.208567:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.208660:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce49de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d2 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.208678:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce49de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d2 expref: 7 pid: 6689 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129203.208696:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcda580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876037626571776:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129203.208845:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48511b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789129203.212770:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129203.213184:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcda580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876037626571776:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129203.213231:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.213260:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363c00, rc 0) 00000100:00100000:0.0:1789129203.213345:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:10725:x1876037604527360:12345-192.168.201.39@tcp:101:bash.0 Request processed in 4962us (6004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129203.213357:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:2.0:1789129203.214322:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604527488 00000100:00100000:2.0:1789129203.214339:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604527488 00010000:00010000:2.0:1789129203.214409:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce49de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d2 expref: 7 pid: 6689 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129203.214467:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:2.0:1789129203.214479:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c53840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604527488:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129203.214503:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129203.214536:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce49de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d2 expref: 7 pid: 6689 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.214552:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce49de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d2 expref: 7 pid: 6689 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.214584:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000818eaf5e/0x5c74554e47ce49de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d2 expref: 7 pid: 6689 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.214627:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129203.214632:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129203.214642:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.214654:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.214700:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129203.214735:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0e3da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876037626571904:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789129203.214848:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789129203.231258:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0e3da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876037626571904:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789129203.231302:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129203.231427:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c53840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604527488:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 16945us (18675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129203.231442:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:1.0:1789129203.236050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129203.236226:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604527744 00000100:00100000:0.0:1789129203.236241:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604527744 00000100:00100000:0.0:1789129203.236329:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:0.0:1789129203.236342:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+33:10725:x1876037604527744:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1789129203.237242:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:10725:x1876037604527744:12345-192.168.201.39@tcp:35:bash.0 Request processed in 894us (1201us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789129203.237270:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1789129203.492494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129203.492797:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604527872 00000100:00100000:3.0:1789129203.492817:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604527872 00000100:00100000:3.0:1789129203.492920:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:3.0:1789129203.492933:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:10741:x1876037604527872:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129203.492970:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129203.493000:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce49ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9e0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.493081:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce49f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.493289:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce49f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.493324:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce49f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129203.493416:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789129203.493421:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129203.493450:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce49f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.493483:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce49ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9e0 expref: 36 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.493586:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce49f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9e0 expref: 35 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.493596:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129203.493598:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789129203.493662:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2200, rc 0) 00000100:00100000:3.0:1789129203.493767:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:10741:x1876037604527872:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 837us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129203.493776:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:1.0:1789129203.507257:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129203.507441:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604528128 00000100:00100000:3.0:1789129203.507459:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604528128 00000100:00100000:3.0:1789129203.507577:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:3.0:1789129203.507591:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:10741:x1876037604528128:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129203.507653:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129203.507686:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce49fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9e7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.507839:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce4a01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.507857:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce4a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.507874:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce4a01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129203.507887:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789129203.508288:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce49fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9e7 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.508313:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce4a01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9e7 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.508750:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:3.0:1789129203.508754:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129203.508758:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2a00, rc 0) 00000100:00100000:3.0:1789129203.508849:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:10741:x1876037604528128:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1260us (1611us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789129203.508858:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:1.0:1789129203.517496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129203.517568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.517665:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604528256 00000100:00100000:2.0:1789129203.517683:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604528256 00000100:00100000:3.0:1789129203.517763:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604528512 00000100:00100000:3.0:1789129203.517770:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604528512 00000100:00100000:2.0:1789129203.517774:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789129203.517788:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:2368:x1876037604528256:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129203.517810:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789129203.517836:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:3.0:1789129203.517851:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:10741:x1876037604528512:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129203.517851:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce4a01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9e7 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.517889:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129203.517902:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789129203.517910:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789129203.517935:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4a0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9ee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129203.517998:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:2368:x1876037604528256:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 214us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129203.518007:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00010000:00010000:3.0:1789129203.518088:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4a16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.518117:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4a16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.518323:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4a16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129203.518342:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789129203.519020:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4a0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9ee expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.519047:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4a16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9ee expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.519068:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789129203.519071:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789129203.519073:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3200, rc 0) 00000100:00100000:2.0:1789129203.519134:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:10741:x1876037604528512:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1290us (1565us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789129203.519143:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:1.0:1789129203.531036:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129203.531157:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604528640 00000100:00100000:3.0:1789129203.531171:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604528640 00000100:00100000:3.0:1789129203.531246:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789129203.531260:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604528640:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:3.0:1789129203.531337:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.531365:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.531375:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129203.531690:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789129203.531697:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.531759:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.531798:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 6 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129203.531817:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1876037626572032:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129203.531968:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4baf1e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129203.537051:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1876037626572032:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129203.537101:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129203.539519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.539660:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604528768 00000100:00100000:2.0:1789129203.539678:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604528768 00002000:00100000:2.0:1789129203.539758:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff90b4bad2b840 x1876037604528768/t0(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:429/0 lens 504/0 e 0 to 0 dl 1789129214 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789129203.539772:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bad2b840 with x1876037604528768 ext(0->8) 00010000:00010000:2.0:1789129203.539786:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 7 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.539808:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 7 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789129203.539816:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b4bad2b840 00000100:00100000:2.0:1789129203.539855:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:2.0:1789129203.539867:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604528768:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:2.0:1789129203.540682:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2369:x1876037604528768:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 811us (1176us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789129203.540694:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00002000:00100000:2.0:1789129203.540703:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff90b4bad2b840 x1876037604528768/t4294967302(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:429/0 lens 504/448 e 0 to 0 dl 1789129214 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789129203.540720:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bad2b840 with x1876037604528768 ext(0->8) 00010000:00010000:2.0:1789129203.540728:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.540743:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789129203.540751:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b4bad2b840 00000100:00100000:3.0:1789129203.548671:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129203.548867:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604528896 00000100:00100000:1.0:1789129203.548882:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604528896 00010000:00010000:1.0:1789129203.548941:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129203.548996:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:1.0:1789129203.549007:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2370:x1876037604528896:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129203.549029:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789129203.549053:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789129203.549057:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789129202 00002000:00010000:1.0:1789129203.549059:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789129203 00002000:00010000:1.0:1789129203.549062:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789129202 00010000:00010000:1.0:1789129203.549069:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129203.549106:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129203.549157:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2afbca1/0x5c74554e47ce49e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9d9 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129203.549181:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789129203.549186:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789129203.549194:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129203.549205:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129203.549244:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129203.549320:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2370:x1876037604528896:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 314us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129203.549329:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00010000:00010000:3.0:1789129203.552037:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.552066:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.552119:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.552130:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.552141:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.552162:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129203.552168:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.552210:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.552249:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.552258:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5d24096/0x5c74554e47ce4a24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129203.552426:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2367:x1876037604528640:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 21161us (21396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129203.552438:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789129203.561144:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129203.561395:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604529152 00000100:00100000:0.0:1789129203.561412:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604529152 00000100:00100000:0.0:1789129203.561514:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:0.0:1789129203.561528:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a07c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:10741:x1876037604529152:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:0.0:1789129203.561800:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4a16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9ee expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789129203.562276:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1789129203.563063:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1789129203.564145:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1789129203.564261:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.564288:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9cb expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.564299:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.564362:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9cb expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.564385:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9cb expref: 42 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129203.564407:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcda580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876037626572160:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129203.565711:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b492287c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789129203.571703:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.571861:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604529280 00000100:00100000:2.0:1789129203.571873:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604529280 00010000:00010000:2.0:1789129203.571938:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9cb expref: 43 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129203.571986:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:2.0:1789129203.571998:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+43:2369:x1876037604529280:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129203.572018:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129203.572026:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9cb expref: 43 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.572043:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9cb expref: 43 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.572073:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:2.0:1789129203.572081:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.572112:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.572121:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.572146:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129203.572224:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+43:2369:x1876037604529280:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 227us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129203.572233:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00010000:00010000:0.0:1789129203.572682:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce49d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9cb expref: 42 pid: 5842 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129203.572704:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcda580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876037626572160:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129203.572733:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.572743:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.572750:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789129203.572990:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789129203.573261:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789129203.573392:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcda580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626572288:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789129203.573469:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129203.573789:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626572288 00000100:00100000:1.0:1789129203.573798:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626572288 00000100:00100000:1.0:1789129203.573860:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789129203.573872:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626572288:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789129203.574283:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626572288:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 413us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129203.574310:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789129203.577116:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b492287c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789129203.577199:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcda580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626572288:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789129203.577903:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1789129203.578023:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcda580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626572416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789129203.578111:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129203.578169:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48511b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789129203.579748:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626572416 00000100:00100000:3.0:1789129203.579771:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626572416 00000100:00100000:3.0:1789129203.579842:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789129203.579855:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626572416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789129203.580235:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1876037626572416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 381us (2121us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789129203.580247:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789129203.580355:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcda580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626572416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789129203.580469:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789129203.580539:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.580552:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.580578:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.580585:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129203.580590:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.580641:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.580663:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789129203.580666:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789129203.580673:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.580680:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4a2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789129203.583734:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789129203.583975:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1789129203.583993:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366681390196ns, next at 367681385492ns, rc = 0 00000001:00080000:0.0:1789129203.584009:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789129203.584649:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8c00) 00010000:00010000:0.0:1789129203.584655:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789129203.584672:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4a16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9ee expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129203.584844:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a07c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:10741:x1876037604529152:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 23318us (23722us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789129203.584875:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000020:00080000:0.0:1789129203.584885:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789129203.590440:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129203.591167:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604529408 00000100:00100000:0.0:1789129203.591183:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604529408 00000100:00100000:0.0:1789129203.591267:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:0.0:1789129203.591282:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:10741:x1876037604529408:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129203.591330:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129203.591364:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4a32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.591449:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4a32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9f5 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.591467:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4a32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9f5 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.591492:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789129203.591496:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129203.591658:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362800, rc 0) 00000100:00100000:2.0:1789129203.597113:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+46:10741:x1876037604529408:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 5814us (6668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129203.597131:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:1.0:1789129203.601339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.601537:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604529664 00000100:00100000:2.0:1789129203.601550:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604529664 00000100:00100000:0.0:1789129203.601679:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:0.0:1789129203.601695:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+46:10741:x1876037604529664:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129203.602025:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+47:10741:x1876037604529664:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 332us (699us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789129203.602036:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1789129203.695966:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129203.696062:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604529792 00000100:00100000:3.0:1789129203.696076:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604529792 00000100:00100000:3.0:1789129203.696158:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:3.0:1789129203.696169:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+47:10751:x1876037604529792:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789129203.696282:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696325:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696342:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696360:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696367:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696374:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696510:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696518:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696525:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789129203.696577:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696591:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696598:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696662:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696670:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129203.696675:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696685:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696701:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129203.696704:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129203.696710:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696718:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696733:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696739:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696746:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696751:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129203.696755:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696769:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696777:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b4909bd300) 00010000:00010000:3.0:1789129203.696779:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129203.696782:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696789:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696804:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696811:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696817:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696822:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129203.696824:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696830:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696836:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789129203.696838:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129203.696840:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.696855:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129203.696963:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+47:10751:x1876037604529792:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 793us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129203.696972:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:1.0:1789129203.738524:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129203.738639:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604530048 00000100:00100000:3.0:1789129203.738652:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604530048 00000100:00100000:3.0:1789129203.738738:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789129203.738750:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+47:10754:x1876037604530048:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129203.738781:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129203.738841:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aa9fc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.738937:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.738956:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.738967:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.738979:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.738984:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739007:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739331:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739338:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739344:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129203.739351:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789129203.739469:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739475:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739480:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739484:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129203.739487:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739493:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739505:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129203.739507:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129203.739518:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739523:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739534:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739537:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739541:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739544:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129203.739546:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739549:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739553:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b4909bd300) 00010000:00010000:3.0:1789129203.739554:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129203.739556:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739559:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4a5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739593:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9fc expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739669:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9fc expref: 49 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.739676:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789129203.739677:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129203.739679:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3800, rc 0) 00000100:00100000:3.0:1789129203.739802:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:10754:x1876037604530048:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1055us (1292us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789129203.739809:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:1.0:1789129203.743510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129203.743749:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604530176 00000100:00100000:3.0:1789129203.743760:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604530176 00000100:00100000:3.0:1789129203.743979:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:3.0:1789129203.743989:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:10754:x1876037604530176:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1789129203.744079:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.744110:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.744123:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.744164:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.744172:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.744200:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.744208:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129203.744213:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.744223:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.744238:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789129203.744242:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789129203.744248:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.744255:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129203.744357:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:10754:x1876037604530176:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 367us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129203.744366:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:1.0:1789129203.746403:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.746501:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604530432 00000100:00100000:2.0:1789129203.746512:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604530432 00000100:00100000:2.0:1789129203.746622:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789129203.746632:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:10754:x1876037604530432:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789129203.747077:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:10754:x1876037604530432:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 446us (693us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789129203.747084:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:1.0:1789129203.815161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129203.815303:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604530688 00000100:00100000:3.0:1789129203.815316:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604530688 00000100:00100000:3.0:1789129203.815453:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:3.0:1789129203.815467:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:10764:x1876037604530688:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129203.815503:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129203.815507:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789129203.815556:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce49f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9e0 expref: 50 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.815647:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129203.815654:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789129203.815675:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa03 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.815817:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.816240:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9fc expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.816251:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.816307:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9fc expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.816327:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9fc expref: 50 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129203.816345:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626572544:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129203.816486:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4baf1e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789129203.820499:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129203.820666:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626572544:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129203.820751:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129203.821287:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604530816 00000100:00100000:2.0:1789129203.821300:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604530816 00010000:00010000:2.0:1789129203.821363:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9fc expref: 51 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129203.821491:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:2.0:1789129203.821504:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:2370:x1876037604530816:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129203.821531:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129203.821539:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9fc expref: 51 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.821554:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9fc expref: 51 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.821588:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9fc expref: 51 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.821641:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789129203.821647:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.821658:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.821667:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.821694:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129203.821781:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:2370:x1876037604530816:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 272us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129203.821796:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00010000:00010000:3.0:1789129203.822932:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.822969:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129203.823005:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789129203.823298:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4a78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa03 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.823321:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa03 expref: 50 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.823331:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789129203.823334:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789129203.823338:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3400, rc 0) 00000100:00100000:3.0:1789129203.823431:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:10764:x1876037604530688:12345-192.168.201.39@tcp:101:bash.0 Request processed in 7966us (8297us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789129203.823441:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:1.0:1789129203.826685:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.826957:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604531072 00000100:00100000:2.0:1789129203.826992:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604531072 00000100:00100000:2.0:1789129203.827118:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 105 00000100:00100000:2.0:1789129203.827132:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:10764:x1876037604531072:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:2.0:1789129203.827522:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.827548:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.827564:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789129203.827673:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789129203.827702:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000be7700d1 reply state 00000000ea25f73a transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129203.827713:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129203.828213:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:10764:x1876037604531072:12345-192.168.201.39@tcp:36:bash.0 Request processed in 1079us (1540us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789129203.828223:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 105 00000020:00080000:2.0:1789129203.828231:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789129203.832640:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.832755:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604531200 00000100:00100000:2.0:1789129203.832780:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604531200 00000100:00100000:2.0:1789129203.832877:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:2.0:1789129203.832890:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:10764:x1876037604531200:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789129203.832926:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129203.832959:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4a94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.833118:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.833153:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa03 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.833163:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.833173:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.833202:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.833243:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa03 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.833260:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa03 expref: 54 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129203.833281:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4c0e3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626572672:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129203.833402:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486015480 going to sleep for 11 seconds 00010000:00010000:3.0:1789129203.833960:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.833970:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.833976:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.833980:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129203.833983:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.834000:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.834016:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789129203.834018:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129203.834020:0:3293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.834029:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.834034:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4a8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129203.837977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.838070:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4c0e3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626572672:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129203.838104:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129203.838526:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604531328 00000100:00100000:3.0:1789129203.838537:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604531328 00010000:00010000:3.0:1789129203.838585:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa03 expref: 54 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129203.838686:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:3.0:1789129203.838695:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:2370:x1876037604531328:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129203.838711:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129203.838717:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa03 expref: 54 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.838727:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa03 expref: 54 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.838750:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4a7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa03 expref: 54 pid: 5840 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.838785:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789129203.838793:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.838802:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.838808:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.838832:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129203.838897:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:2370:x1876037604531328:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 201us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129203.838905:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00010000:00010000:2.0:1789129203.838961:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.838969:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129203.839033:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789129203.839038:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129203.839063:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.839110:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4a94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa0a expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.839127:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa0a expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.839136:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789129203.839139:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789129203.839142:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb800, rc 0) 00000100:00100000:2.0:1789129203.840226:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:10764:x1876037604531200:12345-192.168.201.39@tcp:101:bash.0 Request processed in 7329us (7613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129203.840239:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:1.0:1789129203.842760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129203.842899:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604531584 00000100:00100000:0.0:1789129203.842927:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604531584 00000100:00100000:0.0:1789129203.842991:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:0.0:1789129203.843004:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:10764:x1876037604531584:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1789129203.843816:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:10764:x1876037604531584:12345-192.168.201.39@tcp:35:bash.0 Request processed in 807us (1060us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789129203.844053:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00010000:00010000:3.0:1789129203.910960:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129203.948586:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129203.949382:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604531712 00000100:00100000:3.0:1789129203.949394:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604531712 00000100:00100000:3.0:1789129203.949492:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:3.0:1789129203.949514:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:10770:x1876037604531712:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129203.949544:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129203.949573:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4aa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa11 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.949693:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4aa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.949716:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.949752:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129203.949820:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789129203.949825:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129203.949864:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.949894:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4aa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa11 expref: 55 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.949914:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa11 expref: 54 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.949924:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129203.949928:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789129203.949933:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2400, rc 0) 00000100:00100000:3.0:1789129203.950313:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:10770:x1876037604531712:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 801us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129203.950321:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:1.0:1789129203.954688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.955347:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604531840 00000100:00100000:2.0:1789129203.955360:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604531840 00000100:00100000:2.0:1789129203.955433:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1789129203.955444:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:10770:x1876037604531840:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129203.955467:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129203.955492:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4ab0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa18 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955567:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ab7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955631:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955647:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955670:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4abe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955678:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955685:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955847:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955856:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955863:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129203.955904:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789129203.955909:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129203.955930:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955944:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955965:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ab7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955971:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ab7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955978:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955984:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129203.955988:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ab7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.955995:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ab7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956006:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:2.0:1789129203.956009:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129203.956014:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ab7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956020:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ab7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956031:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4abe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956037:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4abe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956043:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956054:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129203.956057:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4abe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956064:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4abe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956072:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b48544de00) 00010000:00010000:2.0:1789129203.956074:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129203.956076:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4abe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956081:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4abe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956112:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4ab0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa18 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956125:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa18 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.956132:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789129203.956134:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789129203.956137:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eaa00, rc 0) 00000100:00100000:2.0:1789129203.956225:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10770:x1876037604531840:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 781us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129203.956233:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:1.0:1789129203.964795:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129203.964863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129203.964992:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604532096 00000100:00100000:0.0:1789129203.965005:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604532096 00000100:00100000:0.0:1789129203.965104:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:0.0:1789129203.965115:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485da1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10770:x1876037604532096:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129203.965135:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129203.965167:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4acc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.965296:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.965312:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa0a expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.965320:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa18 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.965329:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.965366:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa18 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.965419:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa18 expref: 56 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129203.965435:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626572800:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129203.965593:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa0a expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.965653:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa0a expref: 56 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129203.965664:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626572928:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129203.965698:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129203.966470:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604532224 00000100:00100000:3.0:1789129203.966478:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604532224 00010000:00010000:3.0:1789129203.966523:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa18 expref: 57 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129203.966557:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:3.0:1789129203.966566:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:2367:x1876037604532224:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129203.966592:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129203.966630:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa18 expref: 57 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.966646:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa18 expref: 57 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.966669:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789129203.966674:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.966682:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129203.966688:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129203.966735:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:2367:x1876037604532224:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 169us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129203.966743:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00010000:00010000:0.0:1789129203.968320:0:5840:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.39@tcp) returned -22 from blocking AST (req@00000000ab96efe6 x1876037626572800) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa18 expref: 56 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.968345:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa18 expref: 56 pid: 5842 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129203.968362:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626572800:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129203.968387:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626572928:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129203.968414:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789129203.968419:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.968449:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.968460:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129203.969284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.969391:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604532352 00000100:00100000:2.0:1789129203.969410:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604532352 00010000:00010000:2.0:1789129203.969456:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa0a expref: 56 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129203.970387:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:2.0:1789129203.970405:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:2370:x1876037604532352:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129203.970428:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129203.970437:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa0a expref: 56 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.970451:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa0a expref: 56 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.970486:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4a9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa0a expref: 56 pid: 5841 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.970504:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789129203.970508:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.970517:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.970525:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.970622:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129203.970696:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:2370:x1876037604532352:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 298us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129203.970720:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00010000:00010000:0.0:1789129203.974298:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.974316:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129203.974348:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789129203.974540:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4acc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa1f expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.974561:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa1f expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129203.974571:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789129203.974574:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789129203.974578:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362e00, rc 0) 00000100:00100000:0.0:1789129203.978704:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485da1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10770:x1876037604532096:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 13575us (13909us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789129203.978720:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:1.0:1789129203.996813:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129203.996957:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604532608 00000100:00100000:2.0:1789129203.996969:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604532608 00000100:00100000:2.0:1789129203.997096:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789129203.997108:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10770:x1876037604532608:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:2.0:1789129203.997130:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129203.997179:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4a32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9f5 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129203.997203:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789129203.997209:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129203.997286:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:10770:x1876037604532608:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 180us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129203.997295:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789129204.012746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129204.012895:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604532736 00000100:00100000:0.0:1789129204.012911:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604532736 00000100:00100000:0.0:1789129204.013022:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:0.0:1789129204.013037:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:10770:x1876037604532736:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:0.0:1789129204.013238:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129204.013261:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129204.013277:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789129204.013519:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789129204.013647:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:10770:x1876037604532736:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 614us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129204.013655:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00080000:3.0:1789129204.013749:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129204.022171:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129204.022273:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604532864 00000100:00100000:2.0:1789129204.022283:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604532864 00000100:00100000:2.0:1789129204.022350:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:2.0:1789129204.022360:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:10770:x1876037604532864:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129204.022383:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129204.022406:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4ae8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa26 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.022474:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.022486:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4ae8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa26 expref: 55 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.022526:0:6710:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.022539:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4ae8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa26 expref: 55 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.022555:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789129204.022558:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789129204.022561:0:6710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4ae8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa26 expref: 55 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.022569:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb800, rc 0) 00000100:00100000:2.0:1789129204.022668:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10770:x1876037604532864:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 309us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129204.022676:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000040:00080000:0.0:1789129204.613986:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789129204.614156:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789129204.614230:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789129204.614240:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789129204.614391:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd9e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626573056:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789129204.614966:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129204.622870:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd9e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626573056:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789129204.623120:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129204.623279:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604532992 00000100:00100000:2.0:1789129204.623290:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604532992 00000100:00100000:2.0:1789129204.623371:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:2.0:1789129204.623383:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10771:x1876037604532992:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789129204.623420:0:5841:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789129204.623571:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10771:x1876037604532992:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 189us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129204.623579:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:0.0:1789129204.629469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129204.629690:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604533120 00000100:00100000:2.0:1789129204.629706:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604533120 00000100:00100000:2.0:1789129204.629794:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:2.0:1789129204.629825:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10771:x1876037604533120:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789129204.629955:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4aef lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.629977:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4aef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.629989:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4aef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.630023:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4af6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.630029:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4af6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.630033:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4af6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.630058:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.630066:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.630071:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129204.631304:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789129204.631320:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129204.631354:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.631401:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4aef lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.631408:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4aef lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.631416:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4aef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.631422:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129204.631428:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4aef lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.631437:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4aef lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.631458:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:2.0:1789129204.631461:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129204.631466:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4aef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.631473:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4aef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.631493:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4af6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.631499:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4af6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.631505:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4af6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632819:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129204.632833:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4af6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632847:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4af6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632865:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff90b48544de00) 00010000:00010000:2.0:1789129204.632868:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129204.632873:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4af6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632879:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4af6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632907:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632914:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632920:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632926:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129204.632929:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632935:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632960:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789129204.632963:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129204.632966:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.632972:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4afd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129204.633090:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10771:x1876037604533120:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 3258us (3625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129204.633101:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:3.0:1789129204.642180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129204.642335:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604533376 00000100:00100000:2.0:1789129204.642349:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604533376 00000100:00100000:2.0:1789129204.642434:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:2.0:1789129204.642446:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:10771:x1876037604533376:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789129204.642472:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129204.642503:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b04 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa2d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.642750:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.642768:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.642781:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129204.642796:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789129204.642941:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.642949:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.642955:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.642961:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129204.642965:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.642973:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.642989:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789129204.642992:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789129204.642997:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.643003:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.643048:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b04 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa2d expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.643059:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:2.0:1789129204.643061:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789129204.643064:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b04 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa2d expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.643086:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea400, rc 0) 00000100:00100000:2.0:1789129204.643176:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:10771:x1876037604533376:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 732us (1014us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1789129204.643186:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 114 00000100:00100000:1.0:1789129204.647716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129204.650740:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604533504 00000100:00100000:0.0:1789129204.650828:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604533504 00000100:00100000:0.0:1789129204.650915:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:0.0:1789129204.650925:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:10771:x1876037604533504:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789129204.650969:0:5840:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789129204.652341:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:10771:x1876037604533504:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 1402us (4624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129204.652375:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 115 00000100:00100000:0.0:1789129204.663345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129204.664051:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604533760 00000100:00100000:1.0:1789129204.664069:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604533760 00000100:00100000:1.0:1789129204.664160:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:1.0:1789129204.664171:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:10771:x1876037604533760:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129204.664196:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129204.664199:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789129204.664236:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4aa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa11 expref: 56 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.664279:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:1.0:1789129204.664285:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129204.664305:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa34 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789129204.665260:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789129204.666213:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4b20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.666236:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.666252:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4b20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.666343:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa34 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.666367:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4b20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa34 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.666377:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b49117b700) 00010000:00010000:1.0:1789129204.666381:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789129204.666385:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86c00, rc 0) 00000100:00100000:1.0:1789129204.668108:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:10771:x1876037604533760:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3926us (4761us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789129204.668127:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 116 00000100:00100000:3.0:1789129204.672254:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129204.672371:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604534016 00000100:00100000:2.0:1789129204.672390:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604534016 00000100:00100000:2.0:1789129204.672478:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:2.0:1789129204.672490:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:10771:x1876037604534016:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789129204.672570:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129204.672638:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4b20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa34 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672663:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b49117b700) 00010000:00010000:2.0:1789129204.672677:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789129204.672704:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672721:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672732:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672747:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa719f703 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672754:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa719f703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672778:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa719f703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672878:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672887:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672894:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672901:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129204.672906:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672914:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672924:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:2.0:1789129204.672927:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129204.672931:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672937:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4b2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672946:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa719f703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672952:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa719f703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672963:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa719f703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672968:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129204.672971:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa719f703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672977:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa719f703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.672985:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa719f703 (ffff90b48544de00) 00010000:00010000:2.0:1789129204.672987:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129204.672991:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa719f703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.673008:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa719f703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129204.673105:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:10771:x1876037604534016:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 617us (868us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789129204.673113:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 117 00000100:00100000:0.0:1789129204.677815:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129204.679366:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604534144 00000100:00100000:2.0:1789129204.679385:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604534144 00000100:00100000:2.0:1789129204.679472:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:2.0:1789129204.679485:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:10771:x1876037604534144:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789129204.679513:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129204.679542:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4b3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa3b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.679633:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.679648:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.679662:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.679780:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4b3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa3b expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.679800:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa3b expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.679808:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129204.679811:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789129204.679816:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea200, rc 0) 00000100:00100000:2.0:1789129204.679892:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:10771:x1876037604534144:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 410us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129204.679899:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 118 00000100:00100000:0.0:1789129204.697734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129204.697933:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604534400 00000100:00100000:1.0:1789129204.697944:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604534400 00000100:00100000:1.0:1789129204.698032:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:1.0:1789129204.698043:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:10771:x1876037604534400:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789129204.698162:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.698181:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.698194:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789129204.698872:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1789129204.698887:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367796284344ns, next at 368796281291ns, rc = 0 00000004:00010000:1.0:1789129204.699008:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006123ed90 reply state 00000000d119ce41 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129204.699020:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789129204.699164:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:10771:x1876037604534400:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1120us (1441us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789129204.699172:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 119 00000100:00100000:0.0:1789129204.705924:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129204.706315:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604534528 00000100:00100000:3.0:1789129204.706328:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604534528 00000100:00100000:3.0:1789129204.706401:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 120 00000100:00100000:3.0:1789129204.706413:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:10771:x1876037604534528:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129204.706441:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129204.706464:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4b51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa42 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.706557:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa42 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.706572:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa42 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.706593:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b48544d300) 00010000:00010000:3.0:1789129204.706596:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789129204.706643:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3400, rc 0) 00000100:00100000:3.0:1789129204.706710:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:10771:x1876037604534528:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 300us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129204.706717:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 120 00010000:00010000:2.0:1789129204.708884:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.708907:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.708916:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.708945:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129204.709198:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.709209:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.709232:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129204.709236:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789129204.709242:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129204.709249:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129204.717888:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129204.718692:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604534656 00000100:00100000:0.0:1789129204.718707:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604534656 00000100:00100000:0.0:1789129204.718810:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1789129204.718825:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2370:x1876037604534656:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789129204.719240:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2370:x1876037604534656:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 419us (1365us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789129204.719249:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00080000:3.0:1789129204.719637:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129204.728283:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129204.728445:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604534912 00000100:00100000:2.0:1789129204.728456:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604534912 00000100:00100000:2.0:1789129204.728526:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:2.0:1789129204.728538:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:10771:x1876037604534912:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789129204.728855:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:10771:x1876037604534912:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 319us (583us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789129204.728864:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:0.0:1789129204.736731:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129204.736940:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604535168 00000100:00100000:2.0:1789129204.736952:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604535168 00000100:00100000:2.0:1789129204.737023:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:2.0:1789129204.737037:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:10771:x1876037604535168:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789129204.737192:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:10771:x1876037604535168:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 157us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129204.737218:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 121 00000100:00100000:1.0:1789129204.742335:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129204.743552:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604535296 00000100:00100000:3.0:1789129204.743577:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604535296 00000100:00100000:3.0:1789129204.743732:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:3.0:1789129204.743748:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:10771:x1876037604535296:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129204.743797:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129204.743839:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4b58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa49 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.743945:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.743967:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.744007:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129204.744064:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129204.744105:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.744155:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4b58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa49 expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.744182:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa49 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.744193:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b48544d300) 00010000:00010000:3.0:1789129204.744196:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789129204.744202:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3c00, rc 0) 00000100:00100000:3.0:1789129204.744293:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+61:10771:x1876037604535296:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 549us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129204.744302:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 122 00000100:00100000:0.0:1789129204.750773:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129204.751591:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604535424 00000100:00100000:3.0:1789129204.751631:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604535424 00000100:00100000:3.0:1789129204.751720:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:3.0:1789129204.751733:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2369:x1876037604535424:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129204.751776:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129204.751813:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c498c7a/0x5c74554e47ce4b66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa50 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789129204.751884:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f1f4, blocks: 0x1 00010000:00010000:3.0:1789129204.751918:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1789129204.751924:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129204.751938:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c498c7a/0x5c74554e47ce4b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa50 expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.751961:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005c498c7a/0x5c74554e47ce4b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa50 expref: 10 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.751979:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3a00, rc 0) 00000100:00100000:3.0:1789129204.752067:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:2369:x1876037604535424:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 336us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129204.752210:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:0.0:1789129204.767066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129204.767146:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129204.767200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129204.767306:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604535808 00000100:00100000:3.0:1789129204.767325:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604535808 00000100:00080000:0.0:1789129204.767413:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129204.767423:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:3.0:1789129204.767437:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2370:x1876037604535808:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129204.767498:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604535680 00000100:00100000:1.0:1789129204.767509:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604535680 00000100:00100000:3.0:1789129204.767540:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2370:x1876037604535808:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 104us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129204.767550:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:1.0:1789129204.767584:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:1.0:1789129204.767596:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604535680:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129204.767714:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604535680:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 121us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129204.767739:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:2.0:1789129204.768402:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604535552 00000100:00100000:2.0:1789129204.768414:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604535552 00000100:00100000:2.0:1789129204.768475:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 329 00000100:00100000:2.0:1789129204.768484:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604535552:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129204.768542:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604535552:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 59us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129204.768549:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 329 00000100:00100000:3.0:1789129204.771198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129204.776058:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604536064 00000100:00100000:2.0:1789129204.776092:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604536064 00000100:00100000:2.0:1789129204.776235:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:2.0:1789129204.776249:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+61:10771:x1876037604536064:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789129204.776448:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+61:10771:x1876037604536064:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 201us (5260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129204.776458:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:3.0:1789129204.784185:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129204.784331:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604536192 00000100:00100000:1.0:1789129204.784346:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604536192 00000100:00100000:1.0:1789129204.784423:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:1.0:1789129204.784444:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:10771:x1876037604536192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129204.784468:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129204.784493:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa57 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.784535:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005c498c7a/0x5c74554e47ce4b66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa50 expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.784547:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129204.784552:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129204.784557:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.784667:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005c498c7a/0x5c74554e47ce4b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa50 expref: 11 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.784686:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005c498c7a/0x5c74554e47ce4b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa50 expref: 11 pid: 6689 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129204.784703:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876037626573184:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129204.784847:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789129204.794693:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129204.794810:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876037626573184:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129204.794856:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.794884:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87c00, rc 0) 00000100:00100000:1.0:1789129204.794968:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+11:10771:x1876037604536192:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 10526us (10797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129204.794978:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:3.0:1789129204.801266:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604536320 00000100:00100000:3.0:1789129204.801286:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604536320 00010000:00010000:3.0:1789129204.801470:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005c498c7a/0x5c74554e47ce4b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa50 expref: 11 pid: 6689 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129204.802109:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1789129204.802136:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+11:2370:x1876037604536320:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129204.802160:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129204.802188:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005c498c7a/0x5c74554e47ce4b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa50 expref: 11 pid: 6689 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.802203:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005c498c7a/0x5c74554e47ce4b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa50 expref: 11 pid: 6689 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.802227:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c498c7a/0x5c74554e47ce4b66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa50 expref: 11 pid: 6689 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.802244:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129204.802248:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129204.802256:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.802267:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.802305:0:8444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129204.802335:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1876037626573312:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789129204.802578:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4baf1e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789129204.816303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129204.816434:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604536448 00000100:00100000:1.0:1789129204.816447:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604536448 00002000:00100000:1.0:1789129204.816509:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff90b4bab6c3c0 x1876037604536448/t0(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:430/0 lens 504/0 e 0 to 0 dl 1789129215 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789129204.816522:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bab6c3c0 with x1876037604536448 ext(0->12) 00002000:00010000:1.0:1789129204.816529:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bab6c3c0 00000100:00100000:1.0:1789129204.816567:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1789129204.816577:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bab6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+11:2370:x1876037604536448:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789129204.818673:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bab6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:2370:x1876037604536448:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 2082us (2368us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789129204.818691:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00002000:00100000:1.0:1789129204.818704:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff90b4bab6c3c0 x1876037604536448/t4294967308(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:430/0 lens 504/448 e 0 to 0 dl 1789129215 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789129204.818715:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4bab6c3c0 with x1876037604536448 ext(0->12) 00002000:00010000:1.0:1789129204.818724:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4bab6c3c0 00000100:00100000:3.0:1789129204.823314:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8444:1876037626573312:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789129204.823355:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129204.824043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129204.824233:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604536576 00000100:00100000:3.0:1789129204.824243:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604536576 00000100:00100000:3.0:1789129204.824310:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 124 00000100:00100000:3.0:1789129204.824322:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+61:10771:x1876037604536576:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789129204.829333:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:2370:x1876037604536320:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 27195us (34633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129204.829352:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000001:00080000:0.0:1789129204.900784:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:0.0:1789129204.900812:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789129204.900842:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b492287a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789129204.900847:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4b5aa4700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b492287c00 00000020:00080000:0.0:1789129204.900869:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4b5aa4400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4bab69000 00000001:00080000:0.0:1789129204.900916:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1789129204.900922:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789129204.900951:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1789129204.900958:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1789129204.900987:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789129204.901070:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b48557a900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789129204.901073:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4a77d9300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b48557a180 00000020:00080000:0.0:1789129204.901087:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4a77d9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4bfc55c00 00000100:00100000:3.0:1789129204.901658:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789129204.901679:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626573440:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789129204.901784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129204.901855:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626573568:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789129204.901883:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129204.901905:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129204.901911:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626573696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789129204.901932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129204.901967:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626573440 00000100:00100000:3.0:1789129204.901976:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626573440 00000100:00100000:3.0:1789129204.902032:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626573568 00000100:00100000:3.0:1789129204.902036:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626573568 00000100:00100000:3.0:1789129204.902051:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626573696 00000100:00100000:3.0:1789129204.902054:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626573696 00000100:00100000:3.0:1789129204.902067:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789129204.902088:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626573440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789129204.902115:0:6689:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1789129204.902175:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3f1f2, atime: 0x6aa3f1f3, ctime: 0x6aa3f1f2, blocks: 0x1 00010000:00010000:3.0:1789129204.902184:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c498c7a/0x5c74554e47ce4b74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.902201:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1789129204.902206:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129204.902212:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c498c7a/0x5c74554e47ce4b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.902230:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c498c7a/0x5c74554e47ce4b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.902241:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c498c7a/0x5c74554e47ce4b74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.902249:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c498c7a/0x5c74554e47ce4b74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.902268:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789129204.902879:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626573440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 801us (1092us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789129204.902888:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789129204.902912:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789129204.902920:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626573568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789129204.902937:0:6689:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1789129204.902957:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.902985:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce4936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9b6 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.902993:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789129204.902996:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789129204.903000:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.903030:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce4936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9b6 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.903045:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce4936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9b6 expref: 11 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129204.903057:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876037626573824:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129204.903121:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4baf1ea80 going to sleep for 11 seconds 00000100:00080000:3.0:1789129204.903155:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789129204.903160:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789129204.903170:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129204.903177:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c498c7a/0x5c74554e47ce4b74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.903186:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129204.903192:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c498c7a/0x5c74554e47ce4b74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.903212:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c498c7a/0x5c74554e47ce4b74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.903234:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c498c7a/0x5c74554e47ce4b74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.903242:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c498c7a/0x5c74554e47ce4b74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.903264:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129204.903266:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129204.903267:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789129204.903300:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4b575f480/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789129204.903307:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626573440:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1789129204.905882:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1789129204.909000:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:10771:x1876037604536576:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 84666us (85034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129204.909027:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 124 00000020:00080000:3.0:1789129204.909252:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789129204.923195:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129204.923244:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129204.923535:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789129204.923546:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789129204.924839:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604536704 00000100:00100000:1.0:1789129204.924854:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604536704 00010000:00010000:1.0:1789129204.924908:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce4936 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9b6 expref: 12 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129204.924967:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1789129204.924978:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:2370:x1876037604536704:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129204.924996:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129204.925002:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce4936 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9b6 expref: 12 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.925018:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce4936 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9b6 expref: 12 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.925053:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1789129204.925058:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 1) 00010000:00010000:1.0:1789129204.925064:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.925074:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129204.925094:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129204.925178:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:2370:x1876037604536704:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 201us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129204.925205:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:0.0:1789129204.925430:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604536832 00000100:00100000:0.0:1789129204.925438:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604536832 00000100:00100000:2.0:1789129204.925700:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789129204.925711:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626573696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789129204.926747:0:12455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789129204.926764:0:12455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789129204 00002000:00010000:2.0:1789129204.926767:0:12455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789129204.926769:0:12455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789129204 -> 1789129204 00002000:00010000:2.0:1789129204.926772:0:12455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789129204.927677:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1876037626573696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1963us (25737us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789129204.927690:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789129204.927734:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789129204.927750:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:2370:x1876037604536832:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789129204.928835:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce4936 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aa9b6 expref: 12 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129204.928858:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876037626573824:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129204.928887:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.928898:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.928926:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.928937:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.928945:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.928964:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789129204.929638:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1876037626573568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26717us (27751us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789129204.929648:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1789129204.930481:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129204.930496:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.930509:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129204.930514:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.930526:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.930550:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.930576:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bf0dc17/0x5c74554e47ce4b7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129204.930624:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129204.930626:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129204.930628:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789129204.933916:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4b575d2c0/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789129204.933936:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626573696:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1789129204.934024:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4b575d680/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789129204.934029:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626573568:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789129204.935648:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789129205.106230:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1789129205.106267:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1789129205.106279:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789129205.106290:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789129205.106315:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:2.0:1789129205.106759:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604536832:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 179007us (183505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129205.106772:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789129205.109369:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129205.109872:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604537088 00000100:00100000:3.0:1789129205.109889:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604537088 00000100:00100000:3.0:1789129205.109973:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:3.0:1789129205.109987:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:10771:x1876037604537088:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789129205.110062:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129205.114224:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce4b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa49 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.114255:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b48544d300) 00010000:00010000:3.0:1789129205.114260:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789129205.114510:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.114526:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.114537:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129205.115538:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e96a7229 reply state 000000005d8d8df9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129205.115553:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789129205.115895:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:10771:x1876037604537088:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 5906us (6539us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789129205.115906:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 125 00010000:00010000:3.0:1789129205.118443:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.118462:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.118490:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.118496:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129205.118502:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.118510:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.118530:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b48544d300) 00010000:00010000:3.0:1789129205.118534:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129205.118539:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.118545:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4b82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129205.119528:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129205.119692:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604537216 00000100:00100000:0.0:1789129205.119707:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604537216 00000100:00100000:0.0:1789129205.119781:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:0.0:1789129205.119791:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604537216:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789129205.120194:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789129205.120213:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789129204 -> 1789129203 00002000:00010000:0.0:1789129205.120216:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789129203 00002000:00010000:0.0:1789129205.120219:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789129204 -> 1789129203 00002000:00010000:0.0:1789129205.120221:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789129205.120297:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604537216:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 505us (775us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789129205.120307:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:0.0:1789129205.122465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129205.122892:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604537472 00000100:00100000:1.0:1789129205.122905:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604537472 00000100:00100000:1.0:1789129205.123015:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:1.0:1789129205.123027:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:10771:x1876037604537472:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789129205.123143:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.123161:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa3b expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.123172:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.123215:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa3b expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.123232:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa3b expref: 15 pid: 5841 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129205.123248:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626573952:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129205.123430:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789129205.130135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129205.130278:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626573952:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129205.130314:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129205.130950:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604537600 00000100:00100000:3.0:1789129205.130963:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604537600 00010000:00010000:3.0:1789129205.131018:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa3b expref: 16 pid: 5841 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129205.131091:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:3.0:1789129205.131103:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:2369:x1876037604537600:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129205.131131:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129205.131139:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa3b expref: 16 pid: 5841 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.131181:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa3b expref: 16 pid: 5841 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.131215:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa3b expref: 16 pid: 5841 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.131236:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b48544d300) 00010000:00010000:3.0:1789129205.131243:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.131254:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.131264:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.131290:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129205.131791:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.131811:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.131857:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.131866:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.131875:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.131883:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129205.131888:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.131898:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.131911:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b48544d300) 00010000:00010000:1.0:1789129205.131914:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789129205.131919:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.131925:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129205.133218:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:2369:x1876037604537600:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 274us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129205.133240:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1789129205.135579:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:10771:x1876037604537472:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 12539us (13112us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789129205.135597:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 126 00000100:00100000:2.0:1789129205.152371:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129205.156312:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604537728 00000100:00100000:3.0:1789129205.156330:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604537728 00000100:00100000:3.0:1789129205.156414:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:3.0:1789129205.156425:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604537728:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789129205.156478:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.156521:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.156531:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789129205.156536:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789129205.156541:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.156586:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.156616:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 7 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129205.156632:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876037626574080:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129205.156994:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4baf1ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129205.163570:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876037626574080:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129205.163653:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129205.175329:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129205.175471:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604537856 00000100:00100000:1.0:1789129205.175483:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604537856 00010000:00010000:1.0:1789129205.175530:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 8 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129205.175583:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:1.0:1789129205.175593:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604537856:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129205.175647:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129205.175676:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 8 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.175693:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 8 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.175719:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a78ff418/0x5c74554e47ce4b6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa57 expref: 8 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.175737:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789129205.175741:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789129205.175925:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.175939:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.175977:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129205.176050:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604537856:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 457us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129205.176066:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00010000:00010000:2.0:1789129205.176148:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.176159:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.176193:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.176201:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.176210:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.176217:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129205.176221:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.176231:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.176243:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.176250:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4b90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129205.176312:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604537728:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 19889us (23953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129205.176321:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:0.0:1789129205.183241:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129205.183338:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604538112 00000100:00100000:1.0:1789129205.183354:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604538112 00000100:00100000:1.0:1789129205.183443:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 127 00000100:00100000:1.0:1789129205.183455:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:10771:x1876037604538112:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789129205.183573:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.183598:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.183645:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.184022:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.184035:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4b51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa42 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.184045:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.184167:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa42 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.184182:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4b51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa42 expref: 15 pid: 5841 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129205.184218:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626574208:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129205.184488:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789129205.192490:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129205.192675:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626574208:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129205.192710:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129205.192810:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604538240 00000100:00100000:2.0:1789129205.192820:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604538240 00010000:00010000:2.0:1789129205.192870:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4b51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa42 expref: 16 pid: 5841 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129205.192916:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:2.0:1789129205.192927:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:2369:x1876037604538240:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129205.192952:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129205.192962:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4b51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa42 expref: 16 pid: 5841 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.192977:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa42 expref: 16 pid: 5841 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.193003:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4b51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa42 expref: 16 pid: 5841 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.193023:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b48544d300) 00010000:00010000:2.0:1789129205.193028:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.193038:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.193080:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.193114:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129205.193178:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:2369:x1876037604538240:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 251us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129205.193187:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00010000:00010000:1.0:1789129205.193314:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.193321:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789129205.193554:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789129205.193782:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789129205.193850:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789129205.193979:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876037626574336:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789129205.194087:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129205.194147:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b498909840 going to sleep for 11 seconds 00000100:00100000:2.0:1789129205.194829:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626574336 00000100:00100000:2.0:1789129205.194840:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626574336 00000100:00100000:2.0:1789129205.194910:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789129205.194924:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876037626574336:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789129205.195025:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876037626574336:12345-0@lo:1000:mdt00_002.0 Request processed in 104us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129205.195033:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789129205.196019:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789129205.196029:0:5842:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1789129205.196051:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4b575d2c0, transno 4294967309 00000004:00080000:1.0:1789129205.196067:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4b575d680, transno 4294967310 00000100:00100000:1.0:1789129205.196084:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876037626574336:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789129205.196833:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789129205.196964:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876037626574464:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789129205.197052:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129205.197105:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789129205.198511:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626574464 00000100:00100000:2.0:1789129205.198529:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626574464 00000100:00100000:2.0:1789129205.198622:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789129205.198635:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876037626574464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789129205.198961:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876037626574464:12345-0@lo:1000:mdt00_002.0 Request processed in 328us (1908us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789129205.198971:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789129205.201207:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5842:1876037626574464:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789129205.201282:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201295:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201303:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201310:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129205.201315:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201323:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201346:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b48544d300) 00010000:00010000:1.0:1789129205.201349:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789129205.201355:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201362:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4b9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201406:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201414:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201420:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201452:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129205.201457:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201463:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201473:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789129205.201475:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789129205.201485:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4ae8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa26 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201498:0:5842:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4ae8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa26 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201507:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa26 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.201554:0:5842:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa26 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129205.201570:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626574592:192.168.201.39@tcp:105: 00000100:00100000:1.0:1789129205.201780:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789129205.211743:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129205.212057:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604538368 00000100:00100000:2.0:1789129205.212069:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604538368 00000100:00100000:2.0:1789129205.212144:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:2.0:1789129205.212156:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:10770:x1876037604538368:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:2.0:1789129205.212353:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:10770:x1876037604538368:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 199us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129205.212380:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:1.0:1789129205.212825:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626574592:192.168.201.39@tcp:105: 00010000:00010000:1.0:1789129205.212858:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.212879:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ae1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.212915:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4ba5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.212929:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4ba5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.212940:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4ba5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.212964:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4ba5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.212972:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4ba5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.212979:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4ba5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.212985:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129205.212988:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4ba5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.212996:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4ba5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.213007:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789129205.213010:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129205.213014:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4ba5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.213026:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4ba5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.213038:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.213043:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.213049:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.213053:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129205.213056:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.213062:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.213069:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789129205.213071:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789129205.213074:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.213080:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4b97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789129205.213392:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789129205.213396:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1789129205.213808:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:10771:x1876037604538112:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 30352us (30575us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789129205.213820:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 127 00000020:00080000:1.0:1789129205.213831:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789129205.213923:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789129205.213934:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789129205.224691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129205.225197:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604538624 00000100:00100000:0.0:1789129205.225207:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604538624 00000100:00100000:0.0:1789129205.225274:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789129205.225284:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a05450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:10771:x1876037604538624:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789129205.227452:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789129205.227578:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789129205.227692:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129205.227712:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129205.227724:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129205.227733:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129205.227759:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129205.227767:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129205.228062:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789129205.228229:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a05450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:10771:x1876037604538624:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 2942us (3544us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789129205.228239:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000020:00080000:0.0:1789129205.228246:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789129205.237876:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129205.237914:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.237927:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129205.237931:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.237943:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.237964:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129205.237967:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789129205.237975:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.237981:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4bac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.238222:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129205.238225:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129205.238344:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129205.241330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129205.241377:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604538880 00000100:00100000:3.0:1789129205.241388:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604538880 00000100:00100000:3.0:1789129205.241459:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:3.0:1789129205.241472:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:10770:x1876037604538880:12345-192.168.201.39@tcp:58:lfs.0 00000040:00080000:3.0:1789129205.241895:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789129205.242024:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:10770:x1876037604538880:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 553us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129205.242033:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 128 00000100:00100000:2.0:1789129205.291652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129205.291771:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604539008 00000100:00100000:3.0:1789129205.291786:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604539008 00000100:00100000:1.0:1789129205.291900:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 129 00000100:00100000:1.0:1789129205.291918:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:10773:x1876037604539008:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129205.291957:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129205.291995:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4bb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa5e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292093:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4bba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292115:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4bba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292142:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4bba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292163:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292172:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292180:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292577:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292590:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa1f expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292641:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292682:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa1f expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129205.292697:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa1f expref: 21 pid: 5840 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129205.292713:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626574720:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129205.292848:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789129205.303977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129205.304114:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604539264 00000100:00100000:2.0:1789129205.304133:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604539264 00000100:00100000:1.0:1789129205.304170:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626574720:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129205.304199:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129205.304201:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:2.0:1789129205.304210:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:5610:x1876037604539264:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789129205.304740:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:5610:x1876037604539264:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 527us (777us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789129205.304747:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:0.0:1789129205.310890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129205.311037:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604539392 00000100:00100000:2.0:1789129205.311050:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604539392 00010000:00010000:2.0:1789129205.311200:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa1f expref: 23 pid: 5840 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129205.311368:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1789129205.311383:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:2370:x1876037604539392:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129205.311405:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129205.311413:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa1f expref: 23 pid: 5840 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.311505:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa1f expref: 23 pid: 5840 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.311710:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ad3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa1f expref: 23 pid: 5840 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.311733:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789129205.311741:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.311762:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.311771:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129205.312497:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129205.312599:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:2370:x1876037604539392:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1214us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129205.312653:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00010000:00010000:3.0:1789129205.314885:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.314929:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129205.314990:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789129205.314996:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129205.315023:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315041:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315054:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4bba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315062:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4bba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315154:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4bba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315162:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129205.315167:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4bba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315175:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4bba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315194:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:3.0:1789129205.315198:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129205.315202:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4bba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315218:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4bba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315238:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315244:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315250:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315254:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129205.315257:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315263:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315271:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90b49117bf00) 00010000:00010000:3.0:1789129205.315274:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129205.315276:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4bc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315343:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4bc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315396:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4bb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa5e expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.315413:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa5e expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129205.317276:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789129205.317279:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129205.317346:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86c00, rc 0) 00000100:00100000:3.0:1789129205.317543:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:10773:x1876037604539008:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 25625us (25952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129205.317644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 129 00010000:00010000:1.0:1789129205.957790:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129206.022235:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626574848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129206.022308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129206.022448:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626574848 00000100:00100000:1.0:1789129206.022456:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626574848 00000100:00100000:1.0:1789129206.022517:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789129206.022526:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626574848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789129206.022561:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129206.022631:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626574848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129206.022639:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789129206.022708:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129206.022757:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626574848:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789129206.279311:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129206.279327:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129206.279405:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789129206.279412:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789129206.279584:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626574976:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789129206.279757:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4baf1ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789129206.286946:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780da40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626574976:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789129206.287342:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129206.287869:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604539520 00000100:00100000:1.0:1789129206.287884:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604539520 00000100:00100000:1.0:1789129206.287985:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00100000:1.0:1789129206.288002:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:10784:x1876037604539520:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789129206.288067:0:6710:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789129206.288246:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:10784:x1876037604539520:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 248us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129206.288256:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 130 00000100:00080000:3.0:1789129206.288494:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789129206.294470:0:12494:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789129206.294488:0:12494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789129206.294541:0:12494:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789129206.294548:0:12494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789129206.297177:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129206.297367:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604539776 00000100:00100000:3.0:1789129206.297379:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604539776 00000100:00100000:3.0:1789129206.297456:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:3.0:1789129206.297470:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:10784:x1876037604539776:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129206.297495:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129206.297563:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4bcf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa65 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129206.297743:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4bd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129206.297762:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129206.297776:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129206.297789:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789129206.299302:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4bcf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa65 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129206.299329:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa65 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129206.299339:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789129206.299342:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129206.299346:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3a00, rc 0) 00000100:00100000:3.0:1789129206.299417:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:10784:x1876037604539776:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1950us (2250us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789129206.299428:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 131 00000100:00100000:1.0:1789129206.313375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129206.315156:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604540160 00000100:00100000:3.0:1789129206.315175:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604540160 00000100:00100000:3.0:1789129206.315467:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1789129206.315480:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:2367:x1876037604540160:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129206.315500:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129206.315544:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4bd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa65 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129206.315564:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:3.0:1789129206.315570:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129206.315650:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:2367:x1876037604540160:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 172us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129206.315658:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:3.0:1789129206.317879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129206.321013:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604540032 00000100:00100000:1.0:1789129206.321036:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604540032 00000100:00100000:1.0:1789129206.321138:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 132 00000100:00100000:1.0:1789129206.321152:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:10784:x1876037604540032:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789129206.321407:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4be4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129206.321428:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129206.321441:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129206.323212:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129206.323229:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4be4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129206.323237:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129206.323259:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129206.323744:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129206.323759:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4be4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129206.323785:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789129206.323789:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789129206.323797:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4be4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129206.323805:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4be4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129206.326141:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:10784:x1876037604540032:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 4482us (7757us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789129206.326164:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 132 00000040:00080000:3.0:1789129206.326851:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129206.326860:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129206.327368:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789129206.327378:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789129206.331795:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129206.331843:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604540416 00000100:00100000:3.0:1789129206.331868:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604540416 00000100:00100000:3.0:1789129206.331940:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:3.0:1789129206.331952:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:10784:x1876037604540416:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789129206.333253:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:10784:x1876037604540416:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1290us (1463us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789129206.333269:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00010000:00010000:3.0:1789129206.986959:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789129207.193726:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1789129207.193756:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:0.0:1789129207.558154:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626575360:0@lo:400:kworker.0 00000100:00100000:0.0:1789129207.558244:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129207.558318:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789129207.558324:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626575232:0@lo:400:kworker.0 00000100:00100000:0.0:1789129207.558363:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129207.558388:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626575744:0@lo:400:kworker.0 00000100:00100000:2.0:1789129207.558396:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626575488:0@lo:400:kworker.0 00000100:00100000:0.0:1789129207.558417:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129207.558440:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129207.558454:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626575360 00000100:00100000:0.0:1789129207.558461:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626575360 00000100:00100000:2.0:1789129207.558477:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789129207.558485:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626575104:0@lo:400:kworker.0 00000100:00100000:0.0:1789129207.558518:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626575232 00000100:00100000:2.0:1789129207.558523:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129207.558530:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626575232 00000100:00100000:2.0:1789129207.558554:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626575616:0@lo:400:kworker.0 00000100:00100000:0.0:1789129207.558560:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789129207.558572:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b49036ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626575360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129207.558594:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129207.558695:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626575616 00000100:00100000:1.0:1789129207.558700:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626575616 00000100:00100000:1.0:1789129207.558726:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789129207.558734:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626575232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129207.558811:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626575744 00000100:00100000:2.0:1789129207.558815:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626575744 00000100:00100000:2.0:1789129207.558843:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626575488 00000100:00100000:2.0:1789129207.558846:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626575488 00000100:00100000:2.0:1789129207.558869:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789129207.558876:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626575744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129207.559000:0:5842:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789129207.559010:0:5842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789129207.559057:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789129207.559067:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626575488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129207.562691:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b49036ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626575360:12345-0@lo:400:kworker.0 Request processed in 4105us (4430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129207.562711:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789129207.562770:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789129207.562786:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626575616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129207.563177:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626575616:12345-0@lo:400:kworker.0 Request processed in 397us (4582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129207.563185:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1789129207.563229:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789129207.563237:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129207.563293:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626575360:0@lo:400:kworker.0 00000100:00100000:0.0:1789129207.564571:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626575872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129207.564667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129207.564740:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626575872 00000100:00100000:0.0:1789129207.564748:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626575872 00000100:00100000:0.0:1789129207.564799:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789129207.564809:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626575872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789129207.565532:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129207.565655:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626575872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 846us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129207.565664:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789129207.565745:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626575872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129207.566253:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626575744:12345-0@lo:400:kworker.0 Request processed in 7374us (7833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129207.566266:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789129207.566494:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626575232:12345-0@lo:400:kworker.0 Request processed in 7758us (8129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129207.566508:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789129207.567259:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626575232:0@lo:400:kworker.0 00000100:00100000:1.0:1789129207.568840:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626575104 00000100:00100000:1.0:1789129207.568856:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626575104 00000100:00100000:1.0:1789129207.568928:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789129207.568968:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626575104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129207.578635:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626575488:12345-0@lo:400:kworker.0 Request processed in 19553us (20180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129207.578678:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789129207.579896:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626575616:0@lo:400:kworker.0 00000100:00100000:2.0:1789129207.579920:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789129207.579927:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1789129207.580212:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4b575f480, transno 4294967304 00000100:00100000:2.0:1789129207.580274:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626575488:0@lo:400:kworker.0 00000100:00100000:0.0:1789129207.586901:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626575744:0@lo:400:kworker.0 00000100:00100000:1.0:1789129207.586989:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626575104:12345-0@lo:400:kworker.0 Request processed in 18033us (28461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129207.587002:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789129207.595501:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626575104:0@lo:400:kworker.0 00010000:00010000:2.0:1789129208.005959:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789129208.503407:0:12546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129208.503420:0:12546:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129208.503469:0:12546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789129208.503475:0:12546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789129208.751559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129208.751633:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604540672 00000100:00100000:2.0:1789129208.751644:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604540672 00000100:00100000:2.0:1789129208.751709:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00100000:2.0:1789129208.751721:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:10805:x1876037604540672:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129208.751747:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129208.751770:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4beb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa6c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129208.751900:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce4bf2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129208.751916:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce4bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129208.751929:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce4bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129208.751941:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789129208.752093:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4beb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa6c expref: 27 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129208.752113:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce4bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa6c expref: 26 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129208.752121:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:2.0:1789129208.752125:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789129208.752128:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ebe00, rc 0) 00000100:00100000:2.0:1789129208.752194:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:10805:x1876037604540672:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 475us (646us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789129208.752202:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 133 00000100:00080000:2.0:1789129208.752236:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129208.763918:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129208.764084:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604540800 00000100:00100000:1.0:1789129208.764096:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604540800 00000100:00100000:1.0:1789129208.764159:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:1.0:1789129208.764169:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:10805:x1876037604540800:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:1.0:1789129208.764258:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4c00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129208.764287:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129208.764300:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129208.764328:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129208.764335:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4c00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129208.764343:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129208.764349:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129208.764354:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129208.764362:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4c00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129208.764382:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:1.0:1789129208.764385:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789129208.764390:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4c00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129208.764397:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4c00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129208.764464:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:10805:x1876037604540800:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 296us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129208.764472:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 134 00000100:00100000:2.0:1789129208.850033:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129208.850254:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604540928 00000100:00100000:0.0:1789129208.850264:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604540928 00000100:00100000:0.0:1789129208.850349:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:0.0:1789129208.850359:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604540928:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:0.0:1789129208.850378:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129208.850402:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b424d23/0x5c74554e47ce4c07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa73 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789129208.850430:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3f1f3, atime: 0x6aa3f1f3, ctime: 0x6aa3f1f3, blocks: 0xb 00010000:00010000:0.0:1789129208.850451:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1789129208.850456:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129208.850465:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b424d23/0x5c74554e47ce4c07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa73 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129208.850487:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b424d23/0x5c74554e47ce4c07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa73 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129208.850502:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363800, rc 0) 00000100:00100000:0.0:1789129208.850579:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604540928:12345-192.168.201.39@tcp:101:cat.0 Request processed in 221us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129208.850587:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00080000:2.0:1789129208.851420:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789129208.855463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129208.855594:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604541056 00000100:00100000:0.0:1789129208.855766:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604541056 00002000:00100000:0.0:1789129208.855835:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff90b4a780f0c0 x1876037604541056/t0(0) o3->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:434/0 lens 488/0 e 0 to 0 dl 1789129219 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789129208.855869:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4a780f0c0 with x1876037604541056 ext(0->4095) 00002000:00010000:0.0:1789129208.855876:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4a780f0c0 00000100:00100000:0.0:1789129208.855908:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1789129208.855930:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604541056:12345-192.168.201.39@tcp:3:cat.0 00000100:00100000:0.0:1789129208.857132:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604541056:12345-192.168.201.39@tcp:3:cat.0 Request processed in 1206us (1672us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789129208.857145:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00002000:00100000:0.0:1789129208.857155:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff90b4a780f0c0 x1876037604541056/t0(0) o3->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:434/0 lens 488/4536 e 0 to 0 dl 1789129219 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789129208.857164:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4a780f0c0 with x1876037604541056 ext(0->4095) 00002000:00010000:0.0:1789129208.857169:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4a780f0c0 00010000:00010000:1.0:1789129209.030202:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789129209.417376:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129209.417392:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129209.417437:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789129209.417446:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789129209.886565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129209.886676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129209.886761:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129209.886837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129209.886893:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604541440 00000100:00100000:3.0:1789129209.886909:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604541440 00000100:00100000:3.0:1789129209.887009:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1789129209.887021:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2369:x1876037604541440:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129209.887307:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2369:x1876037604541440:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 286us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129209.887317:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1789129209.887347:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604541312 00000100:00100000:3.0:1789129209.887352:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604541312 00000100:00100000:3.0:1789129209.887463:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604541696 00000100:00100000:3.0:1789129209.887468:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604541696 00000100:00100000:3.0:1789129209.887497:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:3.0:1789129209.887504:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:2370:x1876037604541312:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129209.887539:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:2370:x1876037604541312:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129209.887555:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:3.0:1789129209.887568:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:3.0:1789129209.887574:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382821a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604541696:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129209.887623:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382821a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2369:x1876037604541696:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129209.887631:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00080000:3.0:1789129209.887647:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789129209.887654:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129209.887865:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604541184 00000100:00100000:1.0:1789129209.887871:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604541184 00000100:00100000:1.0:1789129209.887904:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 331 00000100:00100000:1.0:1789129209.887911:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604541184:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129209.887946:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604541184:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129209.887953:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 331 00000100:00100000:3.0:1789129209.891990:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129209.892889:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604541568 00000100:00100000:0.0:1789129209.892906:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604541568 00000100:00100000:0.0:1789129209.892988:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:0.0:1789129209.892999:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382821e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604541568:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129209.893136:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382821e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604541568:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 140us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129209.893145:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00010000:00010000:3.0:1789129210.059969:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789129210.257939:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1789129210.257961:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1789129210.292143:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000001:00080000:0.0:1789129210.292188:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1789129210.292204:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4989093c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789129210.292211:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b491e1e900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b498909840 00000020:00080000:0.0:1789129210.292215:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b491e1e200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b488a7f800 00000001:00080000:0.0:1789129210.293699:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1789129210.293722:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:0.0:1789129210.293725:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1789129210.293991:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789129211.078137:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129211.142575:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626576000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789129211.142722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129211.142977:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626576000 00000100:00100000:2.0:1789129211.142985:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626576000 00000100:00100000:2.0:1789129211.143069:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789129211.143080:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626576000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129211.143117:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129211.143168:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626576000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129211.143176:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789129211.143227:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626576000:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789129211.143358:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789129212.103220:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129212.691758:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129212.691794:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382821680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626576512:0@lo:400:kworker.0 00000100:00100000:1.0:1789129212.691895:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129212.691917:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382820f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626576256:0@lo:400:kworker.0 00000100:00100000:1.0:1789129212.691982:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626576128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129212.691983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129212.692029:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382823c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626576768:0@lo:400:kworker.0 00000100:00100000:1.0:1789129212.692034:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129212.692067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129212.692067:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129212.692077:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626576640:0@lo:400:kworker.0 00000100:00100000:3.0:1789129212.692093:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789129212.692103:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382820780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626576384:0@lo:400:kworker.0 00000100:00100000:1.0:1789129212.692135:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129212.692141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129212.692169:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382820b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626576896:0@lo:400:kworker.0 00000100:00100000:1.0:1789129212.692184:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626576512 00000100:00100000:3.0:1789129212.692193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129212.692197:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626576512 00000100:00100000:3.0:1789129212.692230:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626576768 00000100:00100000:3.0:1789129212.692235:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626576768 00000100:00100000:3.0:1789129212.692280:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626576384 00000100:00100000:3.0:1789129212.692291:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626576384 00000100:00100000:1.0:1789129212.692873:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789129212.692889:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626576768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129212.693077:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626576768:12345-0@lo:400:kworker.0 Request processed in 192us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129212.693087:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789129212.693110:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789129212.693117:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626576512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129212.693154:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626576512:12345-0@lo:400:kworker.0 Request processed in 38us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129212.693161:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789129212.693187:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626576256 00000100:00100000:1.0:1789129212.693192:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626576256 00000100:00100000:1.0:1789129212.693222:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789129212.693230:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626576256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129212.693264:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626576256:12345-0@lo:400:kworker.0 Request processed in 35us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129212.693270:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789129212.693302:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626576128 00000100:00100000:1.0:1789129212.693307:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626576128 00000100:00100000:1.0:1789129212.693340:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789129212.693348:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626576128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129212.693385:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129212.693422:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626576128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129212.693439:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789129212.693653:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789129212.693663:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626576384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129212.693704:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626576384:12345-0@lo:400:kworker.0 Request processed in 43us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129212.693710:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789129212.693733:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626576640 00000100:00100000:3.0:1789129212.693737:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626576640 00000100:00100000:3.0:1789129212.693762:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626576896 00000100:00100000:3.0:1789129212.693765:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626576896 00000100:00100000:3.0:1789129212.693783:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789129212.694052:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626576640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129212.694098:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382821680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626576512:0@lo:400:kworker.0 00000100:00100000:3.0:1789129212.694101:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626576640:12345-0@lo:400:kworker.0 Request processed in 310us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129212.694112:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789129212.694126:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000100:00100000:3.0:1789129212.694128:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000004:00080000:1.0:1789129212.694137:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789129212.694139:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382823840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626576896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129212.694172:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382823840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626576896:12345-0@lo:400:kworker.0 Request processed in 35us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129212.694178:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789129212.694193:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626576128:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789129212.694211:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789129212.694221:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129212.694234:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626576640:0@lo:400:kworker.0 00000100:00100000:3.0:1789129212.694266:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382820780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626576384:0@lo:400:kworker.0 00000100:00100000:3.0:1789129212.694280:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382820b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626576896:0@lo:400:kworker.0 00000100:00100000:3.0:1789129212.694290:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382820f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626576256:0@lo:400:kworker.0 00000100:00100000:3.0:1789129212.694305:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382823c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626576768:0@lo:400:kworker.0 00010000:00010000:0.0:1789129213.125721:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129214.005030:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129214.005079:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604541824 00000100:00100000:1.0:1789129214.005093:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604541824 00000100:00100000:1.0:1789129214.005177:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00100000:1.0:1789129214.005192:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:10450:x1876037604541824:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789129214.005345:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:10450:x1876037604541824:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 156us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129214.005356:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 135 00000100:00080000:3.0:1789129214.006052:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129214.019273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129214.020747:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604542080 00000100:00100000:3.0:1789129214.020775:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604542080 00000100:00100000:3.0:1789129214.021117:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:3.0:1789129214.021136:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:10450:x1876037604542080:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789129214.021997:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:10450:x1876037604542080:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 848us (2720us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789129214.022009:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00010000:00010000:2.0:1789129214.151040:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129214.386251:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129214.386349:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604542208 00000100:00100000:0.0:1789129214.386364:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604542208 00000100:00100000:0.0:1789129214.386487:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:0.0:1789129214.386504:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382823c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:11258:x1876037604542208:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:0.0:1789129214.386541:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129214.386582:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4c0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa7a expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129214.386731:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129214.386753:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129214.386770:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129214.387075:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789129214.387081:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789129214.387703:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129214.387857:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa7a expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129214.387894:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa7a expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129214.387905:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:0.0:1789129214.387908:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789129214.387912:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363000, rc 0) 00000100:00080000:3.0:1789129214.388114:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129214.388164:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382823c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:11258:x1876037604542208:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 1663us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129214.388303:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 136 00000100:00100000:3.0:1789129215.001308:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129215.001370:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129215.001421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129215.001447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129215.001498:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129215.001541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604542336 00000100:00100000:3.0:1789129215.001557:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604542336 00000100:00100000:3.0:1789129215.001683:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 333 00000100:00100000:3.0:1789129215.001697:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604542336:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129215.001808:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604542336:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 115us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129215.001817:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 333 00000100:00100000:3.0:1789129215.001857:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604542720 00000100:00100000:3.0:1789129215.001860:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604542720 00000100:00100000:3.0:1789129215.001897:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604542592 00000100:00100000:3.0:1789129215.001900:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604542592 00000100:00100000:3.0:1789129215.001919:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:3.0:1789129215.001937:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382820b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604542720:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129215.001983:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382820b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604542720:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 46us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129215.001990:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:1.0:1789129215.002004:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604542464 00000100:00100000:3.0:1789129215.002006:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:1.0:1789129215.002012:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604542464 00000100:00100000:3.0:1789129215.002016:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382820780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2369:x1876037604542592:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129215.002044:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382820780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2369:x1876037604542592:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129215.002051:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:1.0:1789129215.002059:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604542848 00000100:00100000:1.0:1789129215.002064:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604542848 00000100:00100000:1.0:1789129215.002095:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:1.0:1789129215.002104:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382820f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2369:x1876037604542464:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129215.002148:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382820f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2369:x1876037604542464:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 46us (858us total) trans 0 rc 0/0 00000100:00080000:2.0:1789129215.002386:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789129215.002392:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129215.002827:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:3.0:1789129215.002840:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2369:x1876037604542848:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129215.002886:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2369:x1876037604542848:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 51us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129215.002906:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:1.0:1789129215.008120:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 181 00010000:00010000:1.0:1789129215.173929:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789129215.308269:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1789129215.308306:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1789129215.308481:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789129215.308495:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789129216.200298:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129216.262522:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626577024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129216.262697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129216.265086:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626577024 00000100:00100000:3.0:1789129216.265109:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626577024 00000100:00100000:3.0:1789129216.265223:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789129216.265237:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626577024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129216.265301:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789129216.265494:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129216.267547:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626577024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2299us (4837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129216.267565:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789129216.279482:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626577024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789129217.224329:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129217.797905:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626577152:0@lo:400:kworker.0 00000100:00100000:2.0:1789129217.797937:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626577536:0@lo:400:kworker.0 00000100:00100000:3.0:1789129217.798078:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626577280:0@lo:400:kworker.0 00000100:00100000:1.0:1789129217.801691:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129217.804663:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129217.805296:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626577664:0@lo:400:kworker.0 00000100:00100000:1.0:1789129217.805388:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129217.805478:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626577152 00000100:00100000:1.0:1789129217.805489:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626577152 00000100:00100000:1.0:1789129217.805558:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789129217.805571:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626577152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129217.805658:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626577152:12345-0@lo:400:kworker.0 Request processed in 88us (3989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129217.805666:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789129217.805729:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626577152:0@lo:400:kworker.0 00000100:00100000:2.0:1789129217.806201:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626577664 00000100:00100000:2.0:1789129217.806210:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626577664 00000100:00100000:2.0:1789129217.806282:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789129217.806292:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626577664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129217.806353:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626577664:12345-0@lo:400:kworker.0 Request processed in 63us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129217.806362:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789129217.806395:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626577664:0@lo:400:kworker.0 00000100:00080000:1.0:1789129217.807502:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129217.808941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129217.809005:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626577280 00000100:00100000:1.0:1789129217.809017:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626577280 00000100:00100000:3.0:1789129217.809026:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626577792:0@lo:400:kworker.0 00000100:00100000:3.0:1789129217.809079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129217.809091:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789129217.809101:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626577280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129217.809105:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789129217.809111:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626577408:0@lo:400:kworker.0 00000100:00100000:3.0:1789129217.809138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129217.809156:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382822580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626577920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129217.809169:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626577280:12345-0@lo:400:kworker.0 Request processed in 69us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129217.809177:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789129217.809202:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626577408 00000100:00100000:1.0:1789129217.809205:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626577408 00000100:00100000:1.0:1789129217.809257:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789129217.809264:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626577408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129217.809304:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626577408:12345-0@lo:400:kworker.0 Request processed in 40us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129217.809311:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:1.0:1789129217.809354:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129217.809965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129217.810086:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626577536 00000100:00100000:2.0:1789129217.810094:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626577536 00000100:00100000:3.0:1789129217.810103:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626577280:0@lo:400:kworker.0 00000100:00100000:3.0:1789129217.810138:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626577408:0@lo:400:kworker.0 00000100:00100000:2.0:1789129217.810138:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626577792 00000100:00100000:2.0:1789129217.810141:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626577792 00000100:00100000:2.0:1789129217.810173:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789129217.810182:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789129217.810182:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626577536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129217.810190:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382822940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626577792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129217.810228:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382822940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626577792:12345-0@lo:400:kworker.0 Request processed in 39us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129217.810231:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626577536:12345-0@lo:400:kworker.0 Request processed in 52us (5582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129217.810235:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789129217.810238:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789129217.810257:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129217.810269:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626577792:0@lo:400:kworker.0 00000100:00100000:2.0:1789129217.810285:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626577536:0@lo:400:kworker.0 00000100:00100000:1.0:1789129217.819752:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626577920 00000100:00100000:1.0:1789129217.819772:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626577920 00000100:00100000:2.0:1789129217.830433:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789129217.830456:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382822d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626577920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129217.830687:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129217.831284:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382822580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626577920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129217.831440:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382822d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626577920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 990us (21474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129217.831452:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:2.0:1789129218.248055:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789129218.337390:0:12747:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:20:16 (1789129216) 00010000:00010000:0.0:1789129219.271778:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129219.538450:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129219.538653:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604543104 00000100:00100000:0.0:1789129219.538667:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604543104 00000100:00100000:0.0:1789129219.538769:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:0.0:1789129219.538784:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:11523:x1876037604543104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789129219.538828:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129219.538862:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4c1c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa81 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.538988:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4c23 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.539008:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4c23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789129219.539324:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789129219.539690:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4c23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.540172:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4c2a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.540199:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4c2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.540214:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4c2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.542652:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4c31 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.542918:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.542932:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4c31 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129219.542947:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789129219.543506:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4c23 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543516:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4c23 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543524:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4c23 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543531:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129219.543544:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4c23 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543553:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4c23 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543570:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:0.0:1789129219.543573:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129219.543578:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4c23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543584:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4c23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543598:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4c2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543885:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4c2a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543892:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4c2a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543897:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129219.543900:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4c2a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543906:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4c2a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543915:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b4976b8200) 00010000:00010000:0.0:1789129219.543917:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129219.543927:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4c2a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.543932:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4c2a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.544455:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4c1c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa81 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.544473:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4c31 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa81 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129219.544481:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:0.0:1789129219.544484:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129219.544486:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:0.0:1789129219.544572:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:11523:x1876037604543104:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5791us (6133us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789129219.544582:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 137 00000100:00100000:3.0:1789129219.549455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129219.549565:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604543232 00000100:00100000:2.0:1789129219.549584:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604543232 00000100:00100000:2.0:1789129219.550231:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:2.0:1789129219.550429:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:2367:x1876037604543232:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129219.550450:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129219.550480:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4c31 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa81 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129219.550518:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:2.0:1789129219.550525:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129219.550913:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2367:x1876037604543232:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 560us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129219.550924:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:2.0:1789129219.558926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129219.559088:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604543360 00000100:00100000:3.0:1789129219.559102:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604543360 00000100:00100000:3.0:1789129219.559187:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 138 00000100:00100000:3.0:1789129219.559201:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:11523:x1876037604543360:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789129219.559356:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:11523:x1876037604543360:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 158us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129219.559366:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 138 00000040:00080000:0.0:1789129219.666333:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789129219.666348:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789129219.675479:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789129219.675499:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789129220.127199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129220.127249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129220.127285:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129220.127309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129220.127357:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129220.127393:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604543744 00000100:00100000:1.0:1789129220.127406:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604543744 00000100:00100000:1.0:1789129220.127474:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604543872 00000100:00100000:1.0:1789129220.127478:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604543872 00000100:00100000:1.0:1789129220.127518:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:1.0:1789129220.127530:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2369:x1876037604543744:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129220.127665:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2369:x1876037604543744:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 135us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129220.127674:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:1.0:1789129220.127694:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789129220.127701:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604543872:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129220.127726:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604543872:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129220.127743:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789129220.127765:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604544000 00000100:00100000:1.0:1789129220.127770:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604544000 00000100:00100000:1.0:1789129220.127949:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604543616 00000100:00100000:1.0:1789129220.127953:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604543616 00000100:00100000:1.0:1789129220.127990:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:1.0:1789129220.127997:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2369:x1876037604544000:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129220.128031:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2369:x1876037604544000:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 35us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129220.128038:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:1.0:1789129220.128050:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:1.0:1789129220.128057:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2369:x1876037604543616:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129220.128084:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:2369:x1876037604543616:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129220.128090:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00080000:1.0:1789129220.128113:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789129220.128119:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789129220.128121:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129220.131732:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604543488 00000100:00100000:3.0:1789129220.131759:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604543488 00000100:00100000:3.0:1789129220.133004:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 335 00000100:00100000:3.0:1789129220.133026:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604543488:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129220.133156:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2369:x1876037604543488:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 139us (5972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129220.133164:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 335 00010000:00010000:0.0:1789129220.293790:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789129220.451085:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:2.0:1789129221.320988:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129221.395527:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129221.395559:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626578048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789129221.395696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129221.395798:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626578048 00000100:00100000:0.0:1789129221.395809:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626578048 00000100:00100000:0.0:1789129221.395920:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789129221.395932:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626578048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129221.395989:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129221.396247:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626578048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 317us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129221.396257:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789129221.396286:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129221.396349:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626578048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789129222.353205:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129222.384231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129222.384374:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604544128 00000100:00100000:2.0:1789129222.384390:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604544128 00000100:00100000:2.0:1789129222.384500:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00100000:2.0:1789129222.384519:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382822580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:11565:x1876037604544128:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129222.384557:0:12509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129222.384591:0:12509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4c3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa88 expref: -99 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.384723:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4c46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.384744:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4c46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.384759:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4c46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.384938:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.384962:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.384969:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385380:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4c46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385391:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4c46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385399:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4c46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385406:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129222.385412:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4c46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385421:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4c46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385440:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:2.0:1789129222.385444:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129222.385451:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4c46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385457:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4c46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385472:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385485:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385491:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385496:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129222.385499:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385505:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385514:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90b48544d200) 00010000:00010000:2.0:1789129222.385517:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129222.385519:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385526:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385575:0:12509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4c3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa88 expref: 14 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385586:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:2.0:1789129222.385588:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129222.385591:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4c3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa88 expref: 14 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.385639:0:12509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea200, rc 0) 00000100:00100000:2.0:1789129222.385736:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382822580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:11565:x1876037604544128:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1225us (1522us total) trans 0 rc 301/301 00000100:00100000:2.0:1789129222.385744:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 139 00000100:00080000:0.0:1789129222.385962:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129222.400088:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129222.400754:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604544384 00000100:00100000:2.0:1789129222.400777:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604544384 00000100:00100000:2.0:1789129222.400868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 140 00000100:00100000:2.0:1789129222.400881:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382821680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:11565:x1876037604544384:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:2.0:1789129222.400964:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129222.401003:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481657600/0x5c74554e47ce45bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8c1 expref: 13 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.401037:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:2.0:1789129222.401044:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789129222.401450:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.401468:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa7a expref: 5 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.401556:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.401637:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa7a expref: 5 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.401657:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa7a expref: 5 pid: 6710 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129222.401687:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626578176:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129222.401837:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d890c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129222.410672:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626578176:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129222.410727:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129222.419504:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129222.419652:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604544512 00000100:00100000:2.0:1789129222.419671:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604544512 00010000:00010000:2.0:1789129222.419756:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa7a expref: 6 pid: 6710 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129222.419833:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:2.0:1789129222.419847:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2367:x1876037604544512:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129222.419868:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129222.419877:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa7a expref: 6 pid: 6710 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.419893:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa7a expref: 6 pid: 6710 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.419924:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4c15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa7a expref: 6 pid: 6710 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.419949:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:2.0:1789129222.419956:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.419968:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.419999:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.420033:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129222.420106:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604544512:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 261us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129222.420115:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00010000:00010000:2.0:1789129222.420273:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.420282:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.420313:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.420324:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.420332:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789129222.422772:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1789129222.426341:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789129222.426387:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.426406:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.426417:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.426444:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129222.426452:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.426464:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.426494:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b49117b800) 00010000:00010000:2.0:1789129222.426498:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129222.426509:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.426519:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c54 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789129222.426560:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f4cbedd3 reply state 000000007b5b42e5 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129222.426577:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129222.430249:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382821680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:11565:x1876037604544384:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 29352us (30159us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789129222.430268:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 140 00010000:00010000:0.0:1789129222.437859:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.437891:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.437901:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.437908:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129222.437914:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.437924:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.437950:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90b48544d200) 00010000:00010000:0.0:1789129222.437953:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129222.437972:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.437979:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4c5b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129222.611711:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129222.613969:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604544640 00000100:00100000:2.0:1789129222.613991:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604544640 00000100:00100000:2.0:1789129222.614598:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:2.0:1789129222.614644:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+13:11573:x1876037604544640:12345-192.168.201.39@tcp:101:lctl.0 00010000:00010000:2.0:1789129222.614703:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129222.614750:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa8f expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.615207:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4c69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.615230:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.615246:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129222.615344:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789129222.615349:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129222.615391:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.615425:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4c62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa8f expref: 15 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.616582:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa8f expref: 14 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.616614:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48544d600) 00010000:00010000:2.0:1789129222.616618:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789129222.616624:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eaa00, rc 0) 00000100:00100000:2.0:1789129222.616731:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:11573:x1876037604544640:12345-192.168.201.39@tcp:101:lctl.0 Request processed in 2096us (5034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129222.616742:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 141 00000100:00100000:0.0:1789129222.731157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129222.731266:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604544768 00000100:00100000:3.0:1789129222.731283:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604544768 00000100:00100000:3.0:1789129222.731368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:3.0:1789129222.731381:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+14:11579:x1876037604544768:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129222.731413:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129222.731452:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa96 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731531:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4c77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731549:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4c77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731567:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4c77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731675:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4c7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731685:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731691:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731870:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731878:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731884:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129222.731922:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1789129222.731926:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129222.731958:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731974:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4c77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731980:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4c77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.731988:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4c77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732005:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129222.732012:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4c77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732022:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4c77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732039:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48544d600) 00010000:00010000:3.0:1789129222.732042:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129222.732051:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4c77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732058:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4c77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732078:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732085:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4c7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732092:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4c7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732098:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129222.732100:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4c7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732107:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4c7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732126:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90b4909bda00) 00010000:00010000:3.0:1789129222.732129:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129222.732132:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4c7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732138:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4c7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732174:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa96 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732192:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa96 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.732201:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129222.732204:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789129222.732206:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3000, rc 0) 00000100:00100000:3.0:1789129222.732573:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:11579:x1876037604544768:12345-192.168.201.39@tcp:101:bash.0 Request processed in 1190us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129222.732585:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 142 00000100:00100000:2.0:1789129222.738680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129222.738824:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604545024 00000100:00100000:3.0:1789129222.738838:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604545024 00000100:00100000:3.0:1789129222.738922:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 143 00000100:00100000:3.0:1789129222.738938:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+15:11579:x1876037604545024:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129222.738976:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129222.739014:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4c8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaa9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.739245:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4c93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.739269:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4c93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.739285:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4c93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.743129:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.743161:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.743177:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789129222.744858:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789129222.745936:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.745964:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.746892:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.746965:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4c93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.747054:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4c93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.747063:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4c93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.747088:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129222.747093:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4c93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.747101:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4c93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.747118:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129222.747121:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129222.747127:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4c93 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.747133:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4c93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129222.747153:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c6ae0481 reply state 00000000508c2000 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129222.747164:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789129222.747219:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4c8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa9d expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.747235:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa9d expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.747244:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789129222.747246:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129222.747248:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363600, rc 0) 00000100:00100000:0.0:1789129222.747430:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11579:x1876037604545024:12345-192.168.201.39@tcp:101:bash.0 Request processed in 8495us (8769us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789129222.747447:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 143 00010000:00010000:3.0:1789129222.772067:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.772105:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129222.772126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:3.0:1789129222.772131:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.772140:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129222.772147:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.772158:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.772185:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4976b8d00) 00010000:00010000:3.0:1789129222.772190:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129222.772195:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129222.772202:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4c9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129222.772260:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604545152 00000100:00100000:1.0:1789129222.772275:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604545152 00000100:00100000:1.0:1789129222.772369:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:1.0:1789129222.772382:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2369:x1876037604545152:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789129222.772409:0:12455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129222.772441:0:12455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4caf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaaa4 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789129222.772499:0:12455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129222.772528:0:12455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=385s v=(0 0) 00010000:00010000:1.0:1789129222.772534:0:12455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129222.772544:0:12455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4caf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaa4 expref: 6 pid: 12455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129222.772572:0:12455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4caf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaa4 expref: 6 pid: 12455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129222.772588:0:12455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87a00, rc 0) 00000100:00100000:1.0:1789129222.772722:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604545152:12345-192.168.201.39@tcp:101:bash.0 Request processed in 342us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129222.772730:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00080000:0.0:1789129222.772827:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129222.776390:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129222.776507:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604545280 00000100:00100000:3.0:1789129222.776524:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604545280 00000100:00100000:0.0:1789129222.776655:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:0.0:1789129222.776681:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:11579:x1876037604545280:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789129222.776704:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129222.776843:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaaab expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.776928:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4caf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaa4 expref: 7 pid: 12455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.776941:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129222.776947:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129222.776955:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.777010:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4caf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaa4 expref: 7 pid: 12455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.777029:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4caf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaa4 expref: 7 pid: 12455 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129222.777051:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876037626578304:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129222.777216:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d89540 going to sleep for 11 seconds 00000100:00100000:0.0:1789129222.783035:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876037626578304:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129222.783101:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.783132:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eac00, rc 0) 00000100:00100000:0.0:1789129222.783266:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:11579:x1876037604545280:12345-192.168.201.39@tcp:101:bash.0 Request processed in 6599us (6886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129222.783276:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:0.0:1789129222.790653:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129222.790775:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604545408 00000100:00100000:3.0:1789129222.790805:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604545408 00010000:00010000:3.0:1789129222.790886:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4caf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaa4 expref: 7 pid: 12455 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129222.791215:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:2.0:1789129222.791237:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604545408:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129222.791263:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129222.791296:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4caf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaa4 expref: 7 pid: 12455 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.791317:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4caf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaa4 expref: 7 pid: 12455 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.791370:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4caf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaa4 expref: 7 pid: 12455 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.791394:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129222.791399:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129222.791410:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.791423:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129222.791501:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129222.791521:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876037626578432:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789129222.793369:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d89540 going to sleep for 11 seconds 00000100:00100000:1.0:1789129222.802125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129222.802321:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604545664 00000100:00100000:3.0:1789129222.802332:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604545664 00000100:00100000:3.0:1789129222.802405:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789129222.802417:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:11579:x1876037604545664:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:2.0:1789129222.802551:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5825:1876037626578432:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789129222.802576:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129222.802655:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604545408:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 11429us (12066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129222.802664:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:3.0:1789129222.802819:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11579:x1876037604545664:12345-192.168.201.39@tcp:35:bash.0 Request processed in 394us (695us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789129222.802828:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:2.0:1789129222.918027:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626578816:0@lo:400:kworker.0 00000100:00100000:2.0:1789129222.918101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129222.918258:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626578944:0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.918333:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626578560:0@lo:400:kworker.0 00000100:00100000:3.0:1789129222.918502:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626578816 00000100:00100000:3.0:1789129222.918510:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626578816 00000100:00100000:3.0:1789129222.918572:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789129222.918581:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490232580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626578816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.921370:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129222.921453:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626579072:0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.921508:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129222.921579:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626579072 00000100:00100000:0.0:1789129222.921588:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626579072 00000100:00100000:0.0:1789129222.921686:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789129222.921696:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626579072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.921798:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626579072:12345-0@lo:400:kworker.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129222.921818:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:0.0:1789129222.921847:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129222.921894:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626579072:0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.921948:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626578688:0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.921978:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129222.921998:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626579200:0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.922023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129222.922046:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129222.922053:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626579328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129222.922077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129222.922106:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626579328 00000100:00100000:0.0:1789129222.922110:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626579328 00000100:00100000:0.0:1789129222.922162:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789129222.922170:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626579328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789129222.922207:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129222.922247:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626579328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129222.922253:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789129222.922277:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626579200 00000100:00100000:0.0:1789129222.922281:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626579200 00000100:00100000:0.0:1789129222.922304:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789129222.922311:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626579200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.922337:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626579200:12345-0@lo:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129222.922350:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1789129222.922364:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129222.922389:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626579328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129222.922398:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902321c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626579200:0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.922419:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626578688 00000100:00100000:0.0:1789129222.922422:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626578688 00000100:00100000:0.0:1789129222.922444:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789129222.922449:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626578688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.922476:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626578688:12345-0@lo:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129222.922482:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789129222.922501:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626578688:0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.922533:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626578560 00000100:00100000:0.0:1789129222.922537:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626578560 00000100:00100000:0.0:1789129222.922563:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789129222.922569:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626578560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.922627:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626578560:12345-0@lo:400:kworker.0 Request processed in 58us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129222.922634:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789129222.922680:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626578560:0@lo:400:kworker.0 00000100:00100000:3.0:1789129222.927488:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490232580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626578816:12345-0@lo:400:kworker.0 Request processed in 8894us (9372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129222.927504:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789129222.927875:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129222.927957:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626578816:0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.929310:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626578944 00000100:00100000:0.0:1789129222.929324:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626578944 00000100:00100000:0.0:1789129222.929409:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789129222.929422:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626578944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129222.929557:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626578944:12345-0@lo:400:kworker.0 Request processed in 137us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129222.929564:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789129222.929855:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c53c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626578944:0@lo:400:kworker.0 00000100:00100000:1.0:1789129222.938064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129222.938674:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604545920 00000100:00100000:0.0:1789129222.938685:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604545920 00000100:00100000:0.0:1789129222.938753:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:0.0:1789129222.938763:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11589:x1876037604545920:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129222.938787:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129222.938822:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4cbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaab2 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129222.938972:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789129222.939139:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4cbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaab2 expref: 20 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.939159:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48544d600) 00010000:00010000:0.0:1789129222.939163:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129222.939359:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4cbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaab2 expref: 20 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129222.939376:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362e00, rc 0) 00000100:00100000:0.0:1789129222.939482:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11589:x1876037604545920:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 719us (1428us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1789129222.939491:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 144 00000100:00100000:0.0:1789129222.948128:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129222.948191:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604546176 00000100:00100000:3.0:1789129222.948204:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604546176 00000100:00100000:3.0:1789129222.948264:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:3.0:1789129222.948274:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11589:x1876037604546176:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129222.948681:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11589:x1876037604546176:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 407us (563us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789129222.948704:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:1.0:1789129223.032229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129223.032686:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604546304 00000100:00100000:0.0:1789129223.032697:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604546304 00000100:00100000:0.0:1789129223.032798:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:0.0:1789129223.032818:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11595:x1876037604546304:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129223.032844:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129223.032871:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ccb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaab9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.032950:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce4cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.032965:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce4cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.032977:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce4cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129223.033043:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1789129223.033046:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789129223.033065:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce4cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.033089:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4ccb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaab9 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.033105:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce4cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaab9 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.033113:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129223.033115:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789129223.033118:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363a00, rc 0) 00000100:00100000:0.0:1789129223.033185:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:11595:x1876037604546304:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 371us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129223.033199:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 145 00000100:00100000:1.0:1789129223.040121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129223.040996:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604546560 00000100:00100000:3.0:1789129223.041012:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604546560 00000100:00100000:3.0:1789129223.041231:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:3.0:1789129223.041244:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:11595:x1876037604546560:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129223.041278:0:12509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129223.041309:0:12509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4cd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaac0 expref: -99 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.041447:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4ce0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.041466:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.041482:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129223.041496:0:12509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789129223.041695:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4cd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaac0 expref: 24 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.041717:0:12509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaac0 expref: 23 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.041725:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:3.0:1789129223.041729:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129223.041734:0:12509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2600, rc 0) 00000100:00100000:3.0:1789129223.042233:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0e3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:11595:x1876037604546560:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 987us (2126us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789129223.042245:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 146 00000100:00100000:3.0:1789129223.046067:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129223.046132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129223.046334:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604546816 00000100:00100000:0.0:1789129223.046351:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604546816 00000100:00100000:0.0:1789129223.046448:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:0.0:1789129223.046462:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:11595:x1876037604546816:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129223.046498:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129223.046536:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4cee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaac7 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.046721:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4cf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.046742:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.046762:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129223.046778:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:2.0:1789129223.046982:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604546944 00000100:00100000:2.0:1789129223.046988:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604546944 00000100:00100000:2.0:1789129223.047042:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789129223.047052:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+25:2367:x1876037604546944:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129223.047065:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129223.047093:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4ce0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaac0 expref: 25 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.047118:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:2.0:1789129223.047124:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129223.047220:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:2367:x1876037604546944:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 169us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129223.047229:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00010000:00010000:0.0:1789129223.048221:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4cee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaac7 expref: 25 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.048246:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4cf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaac7 expref: 24 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.048254:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789129223.048258:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789129223.048260:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362a00, rc 0) 00000100:00100000:0.0:1789129223.048455:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11595:x1876037604546816:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1995us (2408us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789129223.048464:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 147 00000100:00100000:0.0:1789129223.057111:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129223.057198:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604547072 00000100:00100000:2.0:1789129223.057211:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604547072 00000100:00100000:2.0:1789129223.057287:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789129223.057300:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604547072:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:2.0:1789129223.057363:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.057387:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.057396:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789129223.057401:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789129223.057422:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.057486:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.057503:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 6 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129223.057522:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490233840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1876037626579456:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129223.057690:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d89540 going to sleep for 11 seconds 00000100:00100000:0.0:1789129223.063691:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490233840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1876037626579456:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129223.063736:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129223.067147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129223.067562:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604547200 00000100:00100000:1.0:1789129223.067579:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604547200 00002000:00100000:1.0:1789129223.067716:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff90b498ac43c0 x1876037604547200/t0(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:449/0 lens 504/0 e 0 to 0 dl 1789129234 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789129223.067768:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac43c0 with x1876037604547200 ext(0->12) 00010000:00010000:1.0:1789129223.067785:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 7 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.067818:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 7 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789129223.067828:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b498ac43c0 00000100:00100000:1.0:1789129223.067870:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1789129223.067882:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604547200:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:1.0:1789129223.068767:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2369:x1876037604547200:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 875us (1627us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789129223.068782:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00002000:00100000:1.0:1789129223.068794:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff90b498ac43c0 x1876037604547200/t4294967305(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:449/0 lens 504/448 e 0 to 0 dl 1789129234 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789129223.068823:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b498ac43c0 with x1876037604547200 ext(0->12) 00010000:00010000:1.0:1789129223.068837:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 9 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.068862:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 9 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789129223.068871:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b498ac43c0 00000100:00100000:2.0:1789129223.073584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129223.074557:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604547328 00000100:00100000:3.0:1789129223.074572:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604547328 00010000:00010000:3.0:1789129223.074667:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 9 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129223.074779:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:3.0:1789129223.074808:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490230000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2369:x1876037604547328:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129223.074831:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789129223.074859:0:8444:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789129223.074862:0:8444:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789129222 00002000:00010000:3.0:1789129223.074866:0:8444:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789129222 00002000:00010000:3.0:1789129223.074867:0:8444:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789129222 00010000:00010000:3.0:1789129223.074874:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 9 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.074891:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 9 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.074927:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fd49347/0x5c74554e47ce4cb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaab expref: 9 pid: 6686 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.074962:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789129223.074986:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789129223.074994:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.075009:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.075100:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129223.075196:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490230000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604547328:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 405us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129223.075206:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00010000:00010000:0.0:1789129223.076488:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.076516:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.076571:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.076580:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.076589:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.076597:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129223.076615:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.076643:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.076667:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.076676:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce4d03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129223.077123:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604547072:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 19819us (20022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129223.077135:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789129223.080311:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129223.080486:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604547584 00000100:00100000:1.0:1789129223.080520:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604547584 00000100:00100000:1.0:1789129223.080775:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:1.0:1789129223.080789:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11595:x1876037604547584:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:1.0:1789129223.080901:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4cf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaac7 expref: 24 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789129223.081275:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1789129223.081329:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1789129223.082454:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1789129223.082552:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.082577:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa9d expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.082589:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.083335:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa9d expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.083361:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa9d expref: 28 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129223.083383:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876037626579584:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129223.084106:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482ba5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789129223.088823:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129223.088971:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876037626579584:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129223.089011:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129223.092448:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604547712 00000100:00100000:0.0:1789129223.092475:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604547712 00010000:00010000:0.0:1789129223.092559:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa9d expref: 29 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129223.092643:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:0.0:1789129223.092657:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+29:2369:x1876037604547712:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129223.092682:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129223.092690:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa9d expref: 29 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.092707:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa9d expref: 29 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.092768:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4ca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa9d expref: 29 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.092810:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:0.0:1789129223.092817:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.092830:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.092840:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.092875:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129223.092972:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:2369:x1876037604547712:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 318us (4173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129223.092982:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00010000:00010000:3.0:1789129223.093250:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.093259:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789129223.093457:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1789129223.093768:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1789129223.093933:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626579712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789129223.094032:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129223.094084:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486584a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129223.094398:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626579712 00000100:00100000:0.0:1789129223.094409:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626579712 00000100:00100000:0.0:1789129223.094514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789129223.094527:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626579712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789129223.094671:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626579712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129223.094680:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789129223.094761:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129223.094951:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626579712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789129223.105293:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789129223.105439:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b490233840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626579840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789129223.105549:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129223.105632:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d89540 going to sleep for 11 seconds 00000100:00100000:0.0:1789129223.105965:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626579840 00000100:00100000:0.0:1789129223.105975:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626579840 00000100:00100000:0.0:1789129223.106034:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789129223.106046:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626579840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789129223.106346:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1876037626579840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 302us (797us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789129223.106356:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789129223.106902:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b490233840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626579840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789129223.107373:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1789129223.107445:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.107459:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.107469:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.107476:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129223.107482:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.107491:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.107514:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789129223.107518:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789129223.107524:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129223.107531:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4d0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789129223.108374:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789129223.108540:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789129223.108555:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386205951951ns, next at 387205949204ns, rc = 0 00000001:00080000:1.0:1789129223.108565:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789129223.108862:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8f00) 00010000:00010000:1.0:1789129223.108867:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789129223.108895:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4cf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaac7 expref: 32 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129223.109213:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:11595:x1876037604547584:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 28425us (28916us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1789129223.109228:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00000020:00080000:1.0:1789129223.109239:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789129223.113873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129223.114038:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604547840 00000100:00100000:0.0:1789129223.114056:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604547840 00000100:00100000:0.0:1789129223.114144:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:0.0:1789129223.114159:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:11595:x1876037604547840:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129223.114201:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129223.114244:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4d11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaace expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.114492:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4d11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaace expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.114516:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4d11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaace expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.114543:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129223.114547:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129223.114554:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363600, rc 0) 00000100:00100000:0.0:1789129223.114793:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:11595:x1876037604547840:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 637us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129223.114812:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 148 00000100:00100000:1.0:1789129223.123291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129223.123403:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604548096 00000100:00100000:3.0:1789129223.123444:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604548096 00000100:00100000:3.0:1789129223.123686:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:3.0:1789129223.123697:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:11595:x1876037604548096:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129223.125019:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+33:11595:x1876037604548096:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 1310us (1731us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1789129223.125034:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:2.0:1789129223.216174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129223.216350:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604548352 00000100:00100000:3.0:1789129223.216366:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604548352 00000100:00100000:3.0:1789129223.216466:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:3.0:1789129223.216478:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+33:11606:x1876037604548352:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129223.216515:0:12509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129223.216544:0:12509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4d18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaad5 expref: -99 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129223.217083:0:12509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789129223.217251:0:12509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4d18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaad5 expref: 35 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.217287:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48544d600) 00010000:00010000:0.0:1789129223.217290:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129223.217297:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4d18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaad5 expref: 35 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.217314:0:12509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3a00, rc 0) 00000100:00100000:0.0:1789129223.217398:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:11606:x1876037604548352:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 922us (1243us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1789129223.217407:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 149 00000100:00100000:1.0:1789129223.220127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129223.220231:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604548480 00000100:00100000:0.0:1789129223.220245:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604548480 00000100:00100000:0.0:1789129223.220316:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:0.0:1789129223.220330:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:11606:x1876037604548480:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789129223.220458:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220479:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220495:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220515:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220523:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220551:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220724:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220733:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220741:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129223.220825:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220841:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220848:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220856:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220863:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129223.220868:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220877:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220891:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129223.220903:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129223.220911:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220918:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220936:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220942:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220948:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220953:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129223.220956:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220963:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220971:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4976b8b00) 00010000:00010000:0.0:1789129223.220974:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129223.220976:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220981:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.220997:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.221009:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.221015:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.221020:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129223.221023:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.221029:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.221038:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129223.221041:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129223.221044:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.221050:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129223.221326:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:11606:x1876037604548480:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 996us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129223.221338:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 150 00000100:00100000:2.0:1789129223.226987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129223.230306:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604548736 00000100:00100000:3.0:1789129223.230331:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604548736 00000100:00100000:3.0:1789129223.230426:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:3.0:1789129223.230441:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:11606:x1876037604548736:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129223.231000:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:11606:x1876037604548736:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 558us (4024us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789129223.231010:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1789129223.267882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129223.268092:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604548992 00000100:00100000:0.0:1789129223.268109:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604548992 00000100:00100000:0.0:1789129223.268204:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:0.0:1789129223.268221:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:11609:x1876037604548992:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129223.268273:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129223.268335:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaadc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.268448:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.268472:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.268490:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.268509:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.268517:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.268524:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.268807:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.268819:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.268828:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129223.268842:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789129223.269002:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269023:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269030:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269037:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129223.269042:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269052:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269069:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129223.269072:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129223.269079:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269087:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269105:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269110:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269116:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269120:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129223.269130:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269136:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269144:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4976b8b00) 00010000:00010000:0.0:1789129223.269146:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129223.269149:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269154:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4d49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269208:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaadc expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269225:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaadc expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.269232:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129223.269235:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129223.269238:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:0.0:1789129223.269353:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:11609:x1876037604548992:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1136us (1490us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1789129223.269364:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 151 00000100:00100000:1.0:1789129223.273254:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129223.273368:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604549120 00000100:00100000:0.0:1789129223.273386:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604549120 00000100:00100000:0.0:1789129223.273505:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:0.0:1789129223.273522:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:11609:x1876037604549120:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:0.0:1789129223.273698:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.273724:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.273742:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.273782:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.273809:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.273819:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.273826:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129223.273832:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.273842:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.273861:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129223.273864:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129223.273872:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.273880:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129223.273999:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:11609:x1876037604549120:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 480us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129223.274007:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 152 00000100:00100000:3.0:1789129223.277378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129223.277542:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604549376 00000100:00100000:0.0:1789129223.277559:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604549376 00000100:00100000:0.0:1789129223.277684:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:0.0:1789129223.277697:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:11609:x1876037604549376:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129223.278171:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:11609:x1876037604549376:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 474us (811us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789129223.278180:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00010000:00010000:0.0:1789129223.366775:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129223.492017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129223.492220:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604549632 00000100:00100000:3.0:1789129223.492235:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604549632 00000100:00100000:3.0:1789129223.492369:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:3.0:1789129223.492385:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:11640:x1876037604549632:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:3.0:1789129223.492461:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129223.492498:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4d65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.492696:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4d6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.492714:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.492728:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4d6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129223.492743:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789129223.493171:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4d65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaae3 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.493200:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4d6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaae3 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.493212:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129223.493216:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129223.493221:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3a00, rc 0) 00000100:00100000:3.0:1789129223.493482:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+40:11640:x1876037604549632:12345-192.168.201.39@tcp:101:cat.0 Request processed in 1098us (1740us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789129223.493492:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 153 00000100:00100000:1.0:1789129223.501367:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129223.501505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129223.501581:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604550016 00000100:00100000:2.0:1789129223.501595:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604550016 00000100:00100000:2.0:1789129223.501782:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:2.0:1789129223.501813:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+40:2368:x1876037604550016:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129223.501835:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129223.501871:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce4d6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaae3 expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.501923:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789129223.501930:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129223.502012:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+39:2368:x1876037604550016:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 219us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129223.502022:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1789129223.502222:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604549888 00000100:00100000:0.0:1789129223.502228:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604549888 00000100:00100000:0.0:1789129223.502268:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:0.0:1789129223.502276:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+39:11640:x1876037604549888:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:0.0:1789129223.503998:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+40:11640:x1876037604549888:12345-192.168.201.39@tcp:35:cat.0 Request processed in 1707us (2630us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789129223.504015:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:1.0:1789129223.561925:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129223.562067:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604550272 00000100:00100000:2.0:1789129223.562084:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604550272 00000100:00100000:2.0:1789129223.562179:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:2.0:1789129223.562195:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+40:11646:x1876037604550272:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789129223.562234:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129223.562238:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789129223.562277:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce4cd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaab9 expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.562302:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789129223.562308:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789129223.562327:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce4d7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaaea expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.562452:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.562469:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaadc expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.562479:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.562542:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaadc expref: 40 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.562560:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaadc expref: 40 pid: 5841 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129223.562577:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5b94b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626579968:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129223.562766:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129223.566719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129223.566834:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604550400 00000100:00100000:0.0:1789129223.566847:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604550400 00010000:00010000:0.0:1789129223.566912:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaadc expref: 41 pid: 5841 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129223.566962:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:0.0:1789129223.566975:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+41:2370:x1876037604550400:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129223.567017:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129223.567025:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaadc expref: 41 pid: 5841 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.567044:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaadc expref: 41 pid: 5841 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.567077:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129223.567084:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.567095:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.567105:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.567132:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129223.567214:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+41:2370:x1876037604550400:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 241us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129223.567223:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00010000:00010000:2.0:1789129223.567497:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce4d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaadc expref: 40 pid: 5841 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129223.567517:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5b94b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626579968:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129223.567544:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.567554:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.567560:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129223.567581:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789129223.567808:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce4d7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaea expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.567824:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaea expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.567847:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789129223.567850:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789129223.567853:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eae00, rc 0) 00000100:00100000:2.0:1789129223.567884:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+40:11646:x1876037604550272:12345-192.168.201.39@tcp:101:dd.0 Request processed in 5695us (5980us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789129223.567892:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 154 00000100:00100000:3.0:1789129223.570742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129223.570921:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604550656 00000100:00100000:2.0:1789129223.570934:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604550656 00000100:00100000:2.0:1789129223.571018:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 155 00000100:00100000:2.0:1789129223.571031:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+40:11646:x1876037604550656:12345-192.168.201.39@tcp:36:dd.0 00010000:00010000:2.0:1789129223.571377:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.571403:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129223.571421:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789129223.571486:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1789129223.571514:0:6710:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000baf4b3c0 reply state 000000005331ebed transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129223.571525:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129223.571888:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+43:11646:x1876037604550656:12345-192.168.201.39@tcp:36:dd.0 Request processed in 857us (1155us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789129223.571897:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 155 00000020:00080000:2.0:1789129223.571920:0:6710:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789129223.576309:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.576340:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.576352:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.576385:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129223.576393:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.576404:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.576446:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129223.576450:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129223.576458:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.576466:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4d8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129223.844053:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129223.844489:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604550784 00000100:00100000:0.0:1789129223.844503:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604550784 00000100:00100000:0.0:1789129223.844588:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:0.0:1789129223.844640:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+42:11660:x1876037604550784:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:0.0:1789129223.844675:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129223.844704:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaaf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.844807:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.844827:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.844842:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.844878:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4da4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.844886:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.844894:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.845049:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.845058:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaea expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.845065:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.845101:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaea expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.845113:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaea expref: 43 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129223.845126:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626580096:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129223.845239:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129223.853309:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626580096:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129223.853365:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129223.856386:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129223.858228:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604551040 00000100:00100000:1.0:1789129223.858249:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604551040 00000100:00100000:1.0:1789129223.858350:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1789129223.858365:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+44:6071:x1876037604551040:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789129223.858900:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:6071:x1876037604551040:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 536us (2527us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789129223.858910:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:2.0:1789129223.865085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129223.865823:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604551168 00000100:00100000:3.0:1789129223.865841:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604551168 00010000:00010000:3.0:1789129223.865913:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaea expref: 45 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129223.865979:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:3.0:1789129223.865991:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b94b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:2369:x1876037604551168:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129223.866011:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129223.866018:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaea expref: 45 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.866029:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaea expref: 45 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.866065:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eae00/0x5c74554e47ce4d81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaea expref: 45 pid: 5842 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.866085:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129223.866091:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.866099:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.866106:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129223.866134:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129223.866205:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b94b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+44:2369:x1876037604551168:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 217us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129223.866230:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00010000:00010000:0.0:1789129223.867503:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867523:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129223.867597:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789129223.867771:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789129223.867827:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867847:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867860:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867867:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867876:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867883:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129223.867889:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867899:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867918:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129223.867936:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129223.867943:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867949:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4d9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867970:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867977:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4da4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867982:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867988:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129223.867991:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.867996:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.868004:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4976b8b00) 00010000:00010000:0.0:1789129223.868007:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129223.868010:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4da4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.868017:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4da4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.868078:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4d96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf1 expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.868110:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf1 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129223.868119:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129223.868121:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129223.868124:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363400, rc 0) 00000100:00100000:0.0:1789129223.868219:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+43:11660:x1876037604550784:12345-192.168.201.39@tcp:101:stat.0 Request processed in 23619us (24192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129223.868231:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 156 00000100:00100000:2.0:1789129224.027381:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129224.027529:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604551424 00000100:00100000:3.0:1789129224.027549:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604551424 00000100:00100000:3.0:1789129224.027696:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 157 00000100:00100000:3.0:1789129224.027714:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+43:11666:x1876037604551424:12345-192.168.201.39@tcp:36:truncate.0 00010000:00010000:3.0:1789129224.027807:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129224.027851:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce4dab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf1 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.027881:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129224.027887:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1789129224.027901:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789129224.028190:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.028209:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.028223:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789129224.028287:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1789129224.028315:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b3db7a65 reply state 000000009174e190 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129224.028325:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789129224.028465:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:11666:x1876037604551424:12345-192.168.201.39@tcp:36:truncate.0 Request processed in 757us (1104us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789129224.028473:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 157 00000020:00080000:3.0:1789129224.028493:0:5842:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789129224.035585:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.035655:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.035665:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.035672:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129224.035677:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.035687:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.035709:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129224.035712:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129224.035719:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.035743:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce4db2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129224.221760:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.223348:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604551552 00000100:00100000:0.0:1789129224.223368:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604551552 00000100:00100000:0.0:1789129224.223473:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:0.0:1789129224.223487:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+44:11680:x1876037604551552:12345-192.168.201.39@tcp:101:stat.0 00010000:00010000:0.0:1789129224.223526:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129224.223561:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4db9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaaf8 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.223681:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4dc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.223700:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.223713:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.223729:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4dc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.223737:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.223744:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.223883:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224424:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224435:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129224.224492:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789129224.224496:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789129224.224525:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224540:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224553:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224560:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4dc0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224569:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224577:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129224.224583:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224592:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4dc0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224630:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129224.224641:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129224.224646:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4dc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224652:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4dc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224671:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224676:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4dc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224683:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224688:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129224.224691:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224697:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4dc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224707:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4976b8b00) 00010000:00010000:0.0:1789129224.224710:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129224.224713:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4dc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224720:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4dc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224761:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4db9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf8 expref: 46 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224801:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf8 expref: 45 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.224810:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129224.224813:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129224.224815:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362e00, rc 0) 00000100:00100000:0.0:1789129224.226200:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:11680:x1876037604551552:12345-192.168.201.39@tcp:101:stat.0 Request processed in 2692us (4430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129224.226217:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 158 00000100:00100000:3.0:1789129224.345195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.346027:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604551808 00000100:00100000:0.0:1789129224.346043:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604551808 00000100:00100000:0.0:1789129224.346143:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:0.0:1789129224.346156:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+45:11690:x1876037604551808:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129224.346184:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129224.346210:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4dd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaaff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129224.346364:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789129224.346693:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4dd5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaff expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.346711:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48544d600) 00010000:00010000:0.0:1789129224.346715:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129224.346721:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4dd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaff expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.346767:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362a00, rc 0) 00000100:00100000:0.0:1789129224.346860:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+46:11690:x1876037604551808:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 706us (1678us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1789129224.346869:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 159 00000100:00100000:2.0:1789129224.350292:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129224.350382:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604552064 00000100:00100000:1.0:1789129224.350397:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604552064 00000100:00100000:1.0:1789129224.350484:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1789129224.350516:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b488a06c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+46:11690:x1876037604552064:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789129224.351370:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b488a06c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+47:11690:x1876037604552064:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 853us (1093us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789129224.351380:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00010000:00010000:2.0:1789129224.390051:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129224.401158:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129224.401348:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604552320 00000100:00100000:3.0:1789129224.401365:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604552320 00000100:00100000:3.0:1789129224.401464:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:3.0:1789129224.401477:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+47:11696:x1876037604552320:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129224.401515:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129224.401546:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4de3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.402025:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.402044:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf8 expref: 48 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.402054:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.402467:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf8 expref: 48 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.402489:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf8 expref: 48 pid: 6710 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129224.402510:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626580224:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129224.402969:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b490434240 going to sleep for 11 seconds 00000100:00100000:3.0:1789129224.407172:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.407694:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604552448 00000100:00100000:0.0:1789129224.407711:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604552448 00010000:00010000:0.0:1789129224.407794:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf8 expref: 49 pid: 6710 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129224.407852:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:0.0:1789129224.407866:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:2369:x1876037604552448:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129224.407891:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129224.407900:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf8 expref: 49 pid: 6710 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.407916:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf8 expref: 49 pid: 6710 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.407945:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129224.407953:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.407965:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.407975:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.408021:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789129224.408321:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce4dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaaf8 expref: 49 pid: 6710 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129224.408342:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626580224:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129224.408374:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.408384:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.408389:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129224.408414:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000100:00100000:0.0:1789129224.408564:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+49:2369:x1876037604552448:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 699us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129224.408573:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00010000:00010000:2.0:1789129224.408661:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce4de3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab06 expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.408679:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab06 expref: 48 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.408687:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789129224.408690:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789129224.408692:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2c00, rc 0) 00000100:00100000:2.0:1789129224.408731:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+48:11696:x1876037604552320:12345-192.168.201.39@tcp:101:bash.0 Request processed in 7257us (7590us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1789129224.408740:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 160 00000100:00100000:2.0:1789129224.411007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.411182:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604552704 00000100:00100000:0.0:1789129224.411193:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604552704 00000100:00100000:0.0:1789129224.411347:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 161 00000100:00100000:0.0:1789129224.411357:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+48:11696:x1876037604552704:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:0.0:1789129224.411986:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.412007:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.412018:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789129224.412064:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1789129224.412154:0:6710:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005ca91e87 reply state 00000000fb5e4393 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129224.412164:0:6710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789129224.412397:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:11696:x1876037604552704:12345-192.168.201.39@tcp:36:bash.0 Request processed in 1038us (1401us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789129224.412406:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 161 00000020:00080000:0.0:1789129224.412413:0:6710:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789129224.415828:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.415885:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.415894:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.415903:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129224.415910:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.415920:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.415942:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129224.415945:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129224.415952:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.415958:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4df8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129224.423321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.424112:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604552832 00000100:00100000:0.0:1789129224.424129:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604552832 00000100:00100000:0.0:1789129224.424219:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:0.0:1789129224.424231:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:11696:x1876037604552832:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789129224.424265:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129224.424296:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4dff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab0d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.424428:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.424468:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab06 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.424480:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.424531:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab06 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.424549:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab06 expref: 51 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129224.424567:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a780d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626580352:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129224.426350:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48569fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129224.430596:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a780d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626580352:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129224.430672:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129224.430769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129224.430917:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604552960 00000100:00100000:2.0:1789129224.430926:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604552960 00010000:00010000:2.0:1789129224.430987:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab06 expref: 52 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129224.431033:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 74 00000100:00100000:2.0:1789129224.431045:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:2369:x1876037604552960:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129224.431064:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129224.431073:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab06 expref: 52 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.431099:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab06 expref: 52 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.431132:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce4dea lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab06 expref: 52 pid: 5842 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.431153:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789129224.431158:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.431170:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.431202:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.431236:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129224.431332:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:2369:x1876037604552960:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 289us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129224.431341:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 74 00010000:00010000:0.0:1789129224.431533:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.431542:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129224.431640:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789129224.431645:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789129224.431673:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.431724:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4dff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab0d expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.431742:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab0d expref: 50 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.431750:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129224.431753:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129224.431756:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363e00, rc 0) 00000100:00100000:0.0:1789129224.431812:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:11696:x1876037604552832:12345-192.168.201.39@tcp:101:bash.0 Request processed in 7583us (8510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129224.431821:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 162 00000100:00100000:3.0:1789129224.443923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.444031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604553216 00000100:00100000:0.0:1789129224.444048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604553216 00000100:00100000:0.0:1789129224.444128:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:0.0:1789129224.444142:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:11696:x1876037604553216:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:0.0:1789129224.444533:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:11696:x1876037604553216:12345-192.168.201.39@tcp:35:bash.0 Request processed in 392us (629us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1789129224.444543:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1789129224.571807:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129224.572011:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604553472 00000100:00100000:2.0:1789129224.572030:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604553472 00000100:00100000:2.0:1789129224.572137:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:2.0:1789129224.572155:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:11706:x1876037604553472:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129224.572210:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129224.572253:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4e0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab14 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129224.572487:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789129224.572902:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4e0d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab14 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.572923:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48544d600) 00010000:00010000:2.0:1789129224.572927:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789129224.572934:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4e0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab14 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129224.572953:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb600, rc 0) 00000100:00100000:2.0:1789129224.573054:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:11706:x1876037604553472:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 904us (1294us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1789129224.573081:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 163 00000100:00100000:2.0:1789129224.580469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.580588:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604553600 00000100:00100000:0.0:1789129224.580644:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604553600 00000100:00100000:0.0:1789129224.580721:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:0.0:1789129224.580736:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:11706:x1876037604553600:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:0.0:1789129224.580860:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.580906:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.580923:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.580941:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.580949:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.580957:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581090:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581099:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581107:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129224.581157:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581172:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581180:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581198:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581207:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129224.581212:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581221:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581238:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129224.581241:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129224.581247:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581254:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581269:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581276:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581282:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581288:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129224.581291:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581312:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581321:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4976b8b00) 00010000:00010000:0.0:1789129224.581324:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129224.581327:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581334:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581350:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581357:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581363:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581369:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129224.581371:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581378:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581386:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129224.581388:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129224.581391:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.581406:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129224.581523:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:11706:x1876037604553600:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 788us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129224.581531:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 164 00000100:00100000:1.0:1789129224.585717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.586081:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604553856 00000100:00100000:0.0:1789129224.586099:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604553856 00000100:00100000:0.0:1789129224.586189:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:0.0:1789129224.586205:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:11706:x1876037604553856:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129224.587370:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:11706:x1876037604553856:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 1158us (1662us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789129224.587391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789129224.640412:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.640590:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604554112 00000100:00100000:0.0:1789129224.640692:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604554112 00000100:00100000:0.0:1789129224.640815:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:0.0:1789129224.640829:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+53:11709:x1876037604554112:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129224.640872:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129224.640910:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab1b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641008:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641027:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641061:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641079:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641085:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641092:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641294:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4e45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641304:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641310:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129224.641322:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789129224.641467:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641475:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641483:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641490:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129224.641500:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641509:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641523:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129224.641527:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129224.641533:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641541:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641556:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641562:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641568:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641574:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129224.641577:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641583:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641589:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4976b8b00) 00010000:00010000:0.0:1789129224.641592:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129224.641599:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641652:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641711:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab1b expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641728:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4e45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab1b expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.641736:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129224.641739:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129224.641741:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362400, rc 0) 00000100:00100000:0.0:1789129224.641847:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:11709:x1876037604554112:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1020us (1473us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789129224.641856:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 165 00000100:00100000:1.0:1789129224.646721:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129224.646899:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604554240 00000100:00100000:3.0:1789129224.646918:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604554240 00000100:00100000:3.0:1789129224.647008:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:3.0:1789129224.647020:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:11709:x1876037604554240:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1789129224.647129:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.647157:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.647176:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.647213:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.647222:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4e53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.647229:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.647237:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129224.647242:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.647251:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4e53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.647267:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129224.647271:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789129224.647299:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4e53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129224.647308:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce4e53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129224.647437:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:11709:x1876037604554240:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 417us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129224.647448:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 166 00000100:00100000:2.0:1789129224.656909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129224.657597:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604554368 00000100:00100000:1.0:1789129224.657661:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604554368 00000100:00100000:1.0:1789129224.657787:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789129224.657801:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:2367:x1876037604554368:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129224.657826:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129224.657872:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362400/0x5c74554e47ce4e45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab1b expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129224.657900:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:1.0:1789129224.657908:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129224.657989:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:2367:x1876037604554368:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 191us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129224.658000:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789129224.667539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129224.668060:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604554624 00000100:00100000:3.0:1789129224.668077:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604554624 00000100:00100000:2.0:1789129224.668278:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1789129224.668295:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:11709:x1876037604554624:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789129224.673294:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:11709:x1876037604554624:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 4983us (5756us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789129224.673316:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1789129224.902232:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.903914:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604554880 00000100:00100000:0.0:1789129224.903939:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604554880 00000100:00100000:0.0:1789129224.904126:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:0.0:1789129224.904140:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:11727:x1876037604554880:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:0.0:1789129224.904181:0:12509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129224.904215:0:12509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab22 expref: -99 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.904359:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.904400:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.904420:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129224.904437:0:12509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789129224.904839:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab22 expref: 58 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.904869:0:12509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab22 expref: 57 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.904879:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129224.904882:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789129224.904887:0:12509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362a00, rc 0) 00000100:00100000:0.0:1789129224.905062:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:11727:x1876037604554880:12345-192.168.201.39@tcp:101:cat.0 Request processed in 925us (2849us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789129224.905073:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 167 00000100:00100000:1.0:1789129224.955474:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.955907:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604555008 00000100:00100000:0.0:1789129224.955925:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604555008 00000100:00100000:0.0:1789129224.956018:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:0.0:1789129224.956033:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:11728:x1876037604555008:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129224.956073:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129224.957415:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab29 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.957560:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.957578:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.957594:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129224.962333:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789129224.962372:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129224.963052:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129224.964035:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4e6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab29 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129224.964079:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab29 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129224.964092:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789129224.964096:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789129224.964415:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363c00, rc 0) 00000100:00100000:1.0:1789129224.964545:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+58:11728:x1876037604555008:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 8513us (9088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129224.964558:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 168 00000100:00100000:1.0:1789129224.981174:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.981464:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604555392 00000100:00100000:0.0:1789129224.981483:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604555392 00000100:00100000:0.0:1789129224.981580:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:0.0:1789129224.981593:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+58:11728:x1876037604555392:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129224.986054:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:11728:x1876037604555392:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 4433us (4870us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789129224.986081:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:2.0:1789129224.991177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129224.991379:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604555520 00000100:00100000:0.0:1789129224.991397:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604555520 00000100:00100000:0.0:1789129224.991512:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1789129224.991528:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:11728:x1876037604555520:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:0.0:1789129224.991552:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789129224.991593:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab0d expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.991686:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4e61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab22 expref: 58 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.991730:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4d11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaace expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129224.991745:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129224.991762:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129224.991865:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:11728:x1876037604555520:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 341us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129224.991875:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1789129225.005590:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129225.005811:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604555648 00000100:00100000:2.0:1789129225.005888:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604555648 00000100:00100000:2.0:1789129225.005993:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:2.0:1789129225.006007:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:11728:x1876037604555648:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:2.0:1789129225.006364:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce4e7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.006390:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce4e7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.006408:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce4e7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129225.008018:0:6710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789129225.008218:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:11728:x1876037604555648:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 2204us (2635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129225.008238:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 169 00000100:00100000:1.0:1789129225.061220:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129225.067273:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604555776 00000100:00100000:0.0:1789129225.067299:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604555776 00000100:00100000:2.0:1789129225.067702:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:2.0:1789129225.067717:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:11730:x1876037604555776:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129225.067746:0:12509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129225.067785:0:12509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4e84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab30 expref: -99 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.068143:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4e8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.068168:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.068185:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.068211:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4e92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.068220:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.068227:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.068803:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.070733:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.070785:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129225.070886:0:12509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789129225.070890:0:12509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129225.070917:0:12509:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.070935:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.070946:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4e8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.070953:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4e8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.070963:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4e8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.070969:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eac00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129225.070975:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4e8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.070984:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4e8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071000:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789129225.071003:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129225.071009:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4e8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071017:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce4e8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071052:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4e92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071058:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4e92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071063:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4e92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071069:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129225.071072:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4e92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071079:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4e92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071089:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b48544d000) 00010000:00010000:2.0:1789129225.071091:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129225.071095:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4e92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071101:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce4e92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071160:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4e84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab30 expref: 58 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071179:0:12509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab30 expref: 57 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.071200:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b48544d700) 00010000:00010000:2.0:1789129225.071202:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789129225.071205:0:12509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea600, rc 0) 00000100:00100000:2.0:1789129225.071331:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:11730:x1876037604555776:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3617us (10130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129225.071342:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 170 00000100:00100000:1.0:1789129225.251298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129225.251353:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129225.251382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129225.251452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129225.251504:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604556288 00000100:00100000:1.0:1789129225.251517:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604556288 00000100:00080000:1.0:1789129225.251556:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129225.251652:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:1.0:1789129225.251668:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604556288:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129225.251812:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2368:x1876037604556288:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 147us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129225.251821:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:3.0:1789129225.252249:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604555904 00000100:00100000:3.0:1789129225.252257:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604555904 00000100:00100000:3.0:1789129225.252310:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 337 00000100:00100000:3.0:1789129225.252319:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2368:x1876037604555904:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129225.252361:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2368:x1876037604555904:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 44us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129225.252368:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 337 00000100:00100000:0.0:1789129225.252773:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604556160 00000100:00100000:0.0:1789129225.252779:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604556160 00000100:00100000:0.0:1789129225.252834:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604556032 00000100:00100000:0.0:1789129225.252838:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604556032 00000100:00100000:0.0:1789129225.252862:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:0.0:1789129225.252871:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604556160:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129225.252920:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2368:x1876037604556160:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 51us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129225.252927:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:0.0:1789129225.252940:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:0.0:1789129225.252946:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2368:x1876037604556032:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129225.252969:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2368:x1876037604556032:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129225.252974:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00080000:3.0:1789129225.253833:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789129225.253843:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789129225.413794:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789129225.534024:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:1.0:1789129225.534193:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:1.0:1789129225.534472:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626580480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789129225.534579:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129225.534843:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626580480 00000100:00100000:3.0:1789129225.534856:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626580480 00000100:00100000:3.0:1789129225.534946:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789129225.534960:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626580480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789129225.534998:0:6686:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1789129225.535046:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3f206, atime: 0x6aa3f206, ctime: 0x6aa3f206, blocks: 0x1 00010000:00010000:3.0:1789129225.535057:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000086af5c/0x5c74554e47ce4ea0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129225.535101:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=388s v=(0 0) 00010000:00010000:3.0:1789129225.535107:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129225.535117:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000086af5c/0x5c74554e47ce4ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129225.535141:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000086af5c/0x5c74554e47ce4ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129225.535155:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000086af5c/0x5c74554e47ce4ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129225.535165:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000086af5c/0x5c74554e47ce4ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129225.535184:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789129225.536125:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626580480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1160us (1538us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789129225.536138:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789129225.536248:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789129225.536302:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4bae7b480/2, rc 0, transno 4294967307 00000100:00100000:1.0:1789129225.536310:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626580480:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1789129225.536477:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b486584f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789129225.536483:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48659aa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b486584a80 00000020:00080000:1.0:1789129225.536487:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b48659ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4a77b8800 00000020:00080000:3.0:1789129225.536542:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789129225.536866:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789129225.537001:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129225.537021:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000086af5c/0x5c74554e47ce4ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.537039:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129225.537045:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000086af5c/0x5c74554e47ce4ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.537059:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000086af5c/0x5c74554e47ce4ea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.537089:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000086af5c/0x5c74554e47ce4ea0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.537098:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000086af5c/0x5c74554e47ce4ea0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.537125:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129225.537127:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129225.537129:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789129225.800789:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129225.800800:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129225.800855:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789129225.800862:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789129225.801041:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626580608:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789129225.801188:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48511b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129225.816495:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626580608:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789129225.828872:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129225.829151:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604556416 00000100:00100000:0.0:1789129225.829167:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604556416 00000100:00100000:0.0:1789129225.829249:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:0.0:1789129225.829262:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:11741:x1876037604556416:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789129225.829308:0:6710:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789129225.831685:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:11741:x1876037604556416:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 2399us (2805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129225.831800:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 171 00000100:00100000:3.0:1789129225.837023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129225.840660:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604556544 00000100:00100000:2.0:1789129225.840692:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604556544 00000100:00100000:2.0:1789129225.840814:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:2.0:1789129225.840829:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:11741:x1876037604556544:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789129225.840947:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ea7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.840971:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.840987:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841009:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4eae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841016:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841023:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841079:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841089:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841095:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129225.841152:0:12509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789129225.841157:0:12509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129225.841177:0:12509:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841192:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841200:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ea7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841209:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841217:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129225.841222:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841232:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841247:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:2.0:1789129225.841256:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129225.841264:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ea7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841270:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea400/0x5c74554e47ce4ea7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841286:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4eae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841292:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4eae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841299:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4eae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841307:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129225.841310:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4eae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841316:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4eae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841322:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff90b48544d000) 00010000:00010000:2.0:1789129225.841325:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129225.841328:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4eae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841333:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce4eae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841347:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841359:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841364:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841369:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129225.841372:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841378:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841388:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b48544d700) 00010000:00010000:2.0:1789129225.841390:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129225.841393:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129225.841398:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce4eb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129225.842667:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:11741:x1876037604556544:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 1827us (5641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129225.842686:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 172 00000100:00100000:2.0:1789129225.853873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129225.854271:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604556800 00000100:00100000:1.0:1789129225.854291:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604556800 00000100:00100000:1.0:1789129225.854817:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:1.0:1789129225.854838:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+16:11741:x1876037604556800:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129225.854875:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129225.854910:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4ebc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.855061:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.855085:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.855101:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129225.855115:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789129225.857046:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.857068:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.857078:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.857085:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129225.857091:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.857099:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.857121:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b48544d700) 00010000:00010000:1.0:1789129225.857124:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789129225.857130:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4ec3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.857151:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce4ec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.857220:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4ebc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab37 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.857232:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:1.0:1789129225.857235:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789129225.857239:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4ebc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab37 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.857249:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87a00, rc 0) 00000100:00100000:1.0:1789129225.857348:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:11741:x1876037604556800:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2515us (3493us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1789129225.857361:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 173 00000100:00100000:1.0:1789129225.871355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129225.876001:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604556928 00000100:00100000:2.0:1789129225.876033:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604556928 00000100:00100000:2.0:1789129225.876155:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:2.0:1789129225.876173:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:11741:x1876037604556928:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789129225.876268:0:6710:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789129225.877050:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:11741:x1876037604556928:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 870us (5702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129225.877062:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 174 00000100:00100000:3.0:1789129225.883164:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129225.888931:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604557184 00000100:00100000:2.0:1789129225.888961:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604557184 00000100:00100000:0.0:1789129225.889484:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:0.0:1789129225.889518:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:11741:x1876037604557184:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789129225.889558:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129225.889712:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789129225.889772:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce4e76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab29 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.889798:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129225.889807:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129225.889829:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4ed1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab3e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789129225.893072:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789129225.894837:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.894869:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.894889:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.894986:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4ed1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab3e expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.895008:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab3e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.895019:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129225.895022:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129225.895026:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363e00, rc 0) 00000100:00100000:0.0:1789129225.895179:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11741:x1876037604557184:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5680us (12034us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1789129225.895204:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 175 00000100:00100000:3.0:1789129225.902156:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129225.902230:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604557440 00000100:00100000:0.0:1789129225.902244:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604557440 00000100:00100000:0.0:1789129225.902322:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:0.0:1789129225.902334:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11741:x1876037604557440:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789129225.902471:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129225.902526:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4ed8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab3e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.902554:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129225.902570:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129225.902636:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4ee6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.902656:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.902669:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.909450:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4eed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6fe16695 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.909481:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4eed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fe16695 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.909501:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4eed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fe16695 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.909941:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.909950:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4ee6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.909956:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912356:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129225.912363:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912374:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912393:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129225.912396:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129225.912401:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4ee6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912407:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4ee6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912428:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4eed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fe16695 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912435:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4eed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fe16695 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912442:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4eed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fe16695 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912464:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129225.912467:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4eed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fe16695 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912474:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4eed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6fe16695 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912483:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6fe16695 (ffff90b4976b8100) 00010000:00010000:0.0:1789129225.912485:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129225.912488:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4eed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6fe16695 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.912495:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4eed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6fe16695 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129225.914555:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:11741:x1876037604557440:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 12210us (12404us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789129225.914568:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 176 00000100:00100000:3.0:1789129225.917303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129225.926853:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604557568 00000100:00100000:1.0:1789129225.926878:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604557568 00000100:00100000:0.0:1789129225.930112:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:0.0:1789129225.930134:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:11741:x1876037604557568:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789129225.930172:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129225.930215:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4ef4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab45 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.930269:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.930288:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.930316:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.930464:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4ef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab45 expref: 19 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.930490:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab45 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.930510:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:0.0:1789129225.930513:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789129225.930518:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362000, rc 0) 00000100:00100000:0.0:1789129225.930648:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11741:x1876037604557568:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 519us (13359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129225.930656:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 177 00000100:00100000:1.0:1789129225.937238:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129225.938138:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604557824 00000100:00100000:0.0:1789129225.938159:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604557824 00000100:00100000:0.0:1789129225.938257:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 178 00000100:00100000:0.0:1789129225.938272:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11741:x1876037604557824:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789129225.938424:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.938448:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129225.938465:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789129225.939238:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1789129225.939253:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 389036650672ns, next at 390036648179ns, rc = 0 00000004:00010000:0.0:1789129225.939369:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005acc72c3 reply state 00000000f62b86ac transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129225.939382:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789129225.940305:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11741:x1876037604557824:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 2026us (3071us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1789129225.940322:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 178 00010000:00010000:1.0:1789129225.950223:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.950247:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.950256:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.950263:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129225.950287:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.950298:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.950326:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:1.0:1789129225.950330:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789129225.950336:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.950344:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce4f02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129225.953777:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129225.954236:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604557952 00000100:00100000:3.0:1789129225.954252:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604557952 00000100:00100000:3.0:1789129225.954340:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00100000:3.0:1789129225.954355:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11741:x1876037604557952:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129225.954397:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129225.954435:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4f09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab4c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129225.954582:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab4c expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129225.954630:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab4c expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129225.954655:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:3.0:1789129225.954659:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789129225.954664:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3400, rc 0) 00000100:00100000:3.0:1789129225.954961:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11741:x1876037604557952:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 608us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129225.954969:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 179 00000100:00100000:3.0:1789129225.957693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129225.958943:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604558080 00000100:00100000:1.0:1789129225.958960:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604558080 00000100:00100000:1.0:1789129225.959047:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:1.0:1789129225.959061:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604558080:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789129225.959630:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2369:x1876037604558080:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 543us (1919us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789129225.959641:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:1.0:1789129225.963717:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129225.963862:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604558336 00000100:00100000:2.0:1789129225.963880:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604558336 00000100:00100000:2.0:1789129225.963970:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789129225.963985:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11741:x1876037604558336:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789129225.964288:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:11741:x1876037604558336:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 306us (594us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789129225.964296:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:1.0:1789129225.967404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129225.967486:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604558592 00000100:00100000:2.0:1789129225.967510:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604558592 00000100:00100000:2.0:1789129225.967587:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:2.0:1789129225.967598:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:11741:x1876037604558592:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789129225.968043:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e44b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:11741:x1876037604558592:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 442us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129225.968053:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 180 00000100:00100000:3.0:1789129225.973403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129225.973498:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604558720 00000100:00100000:1.0:1789129225.973515:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604558720 00000100:00100000:1.0:1789129225.973624:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:1.0:1789129225.973640:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:11741:x1876037604558720:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129225.973677:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129225.973738:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab53 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.973854:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.973875:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.973890:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129225.973940:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129225.973964:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.973996:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab53 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.974018:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab53 expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129225.974028:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:1.0:1789129225.974031:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789129225.974036:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86000, rc 0) 00000100:00100000:1.0:1789129225.974125:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:11741:x1876037604558720:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 488us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129225.974134:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 181 00000100:00100000:0.0:1789129225.983126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129225.983213:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604558848 00000100:00100000:3.0:1789129225.983228:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604558848 00000100:00100000:3.0:1789129225.983308:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1789129225.983320:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604558848:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129225.983351:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129225.983395:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4f1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab5a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789129225.983435:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f209, blocks: 0x1 00010000:00010000:3.0:1789129225.983465:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=389s v=(0 0) 00010000:00010000:3.0:1789129225.983470:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129225.983484:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab5a expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129225.983513:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab5a expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129225.983531:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3c00, rc 0) 00000100:00100000:3.0:1789129225.983643:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2370:x1876037604558848:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 324us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129225.983652:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:3.0:1789129225.986346:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129225.988847:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604559104 00000100:00100000:2.0:1789129225.988872:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604559104 00000100:00100000:2.0:1789129225.988965:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:2.0:1789129225.988979:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:11741:x1876037604559104:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789129225.989128:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:11741:x1876037604559104:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 151us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129225.989144:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 182 00000100:00100000:0.0:1789129226.002267:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129226.002356:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604559232 00000100:00100000:1.0:1789129226.002371:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604559232 00000100:00100000:1.0:1789129226.002480:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:1.0:1789129226.002493:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:11741:x1876037604559232:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129226.002524:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129226.002550:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab61 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.002596:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4f1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab5a expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.002644:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129226.002649:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129226.002655:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.002698:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab5a expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.002726:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4f1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab5a expref: 9 pid: 6686 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129226.002747:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e470c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876037626580736:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129226.002894:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482ba5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789129226.007530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129226.007697:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604559360 00000100:00100000:2.0:1789129226.007721:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604559360 00010000:00010000:2.0:1789129226.007806:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4f1e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab5a expref: 10 pid: 6686 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129226.007863:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:2.0:1789129226.007879:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:2369:x1876037604559360:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129226.007908:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129226.007948:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4f1e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab5a expref: 10 pid: 6686 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.007969:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4f1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab5a expref: 10 pid: 6686 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.008012:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129226.008019:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129226.008031:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.008054:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.008106:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 10 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129226.008140:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5af5a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1876037626580864:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789129226.008263:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4baf1e3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789129226.008554:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce4f1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab5a expref: 10 pid: 6686 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129226.008574:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e470c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876037626580736:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129226.008639:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.008650:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87a00, rc 0) 00000100:00100000:1.0:1789129226.008687:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:11741:x1876037604559232:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 6196us (6437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129226.008704:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:0.0:1789129226.013041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129226.013277:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5af5a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5826:1876037626580864:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789129226.013315:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129226.013403:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d72580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604559360:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 5526us (5887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129226.013418:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 75 00000100:00100000:3.0:1789129226.014056:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604559488 00000100:00100000:3.0:1789129226.014068:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604559488 00002000:00100000:3.0:1789129226.014154:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff90b490230000 x1876037604559488/t0(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:452/0 lens 504/0 e 0 to 0 dl 1789129237 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129226.014187:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b490230000 with x1876037604559488 ext(0->8) 00002000:00010000:3.0:1789129226.014195:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b490230000 00000100:00100000:3.0:1789129226.014238:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1789129226.014251:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2370:x1876037604559488:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789129226.015522:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490230000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:2370:x1876037604559488:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 1261us (2489us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789129226.015538:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00002000:00100000:2.0:1789129226.015549:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff90b490230000 x1876037604559488/t4294967314(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:452/0 lens 504/448 e 0 to 0 dl 1789129237 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789129226.015559:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b490230000 with x1876037604559488 ext(0->8) 00002000:00010000:2.0:1789129226.015565:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b490230000 00000100:00100000:0.0:1789129226.019675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129226.019859:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604559616 00000100:00100000:2.0:1789129226.019876:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604559616 00000100:00100000:2.0:1789129226.019989:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:2.0:1789129226.020005:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:11741:x1876037604559616:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000100:00080000:1.0:1789129226.020337:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789129226.099271:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000100:00100000:2.0:1789129226.100258:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:11741:x1876037604559616:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 80245us (80642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129226.100278:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 183 00000100:00100000:3.0:1789129226.102860:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000004:00080000:1.0:1789129226.103001:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1789129226.103066:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1789129226.103079:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1789129226.103264:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789129226.103279:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789129226.105281:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626580992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789129226.105577:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129226.106102:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604559744 00000100:00100000:3.0:1789129226.106121:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604559744 00000100:00100000:2.0:1789129226.107310:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626580992 00000100:00100000:2.0:1789129226.107326:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626580992 00000100:00100000:2.0:1789129226.107522:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789129226.107539:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626580992:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789129226.108137:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129226.109856:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:3.0:1789129226.109875:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:2369:x1876037604559744:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00002000:00010000:2.0:1789129226.111622:0:12455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789129226.111635:0:12455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789129225 00002000:00010000:2.0:1789129226.111639:0:12455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789129226.111642:0:12455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789129225 -> 1789129225 00002000:00010000:2.0:1789129226.111644:0:12455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789129226.118003:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626580992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 10452us (12408us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789129226.118024:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1789129226.123190:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b383e470c0/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789129226.123219:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626580992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789129226.251020:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:2369:x1876037604559744:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 141132us (148158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129226.251035:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000001:00080000:3.0:1789129226.251082:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1789129226.251097:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1789129226.251102:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1789129226.255112:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129226.255272:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604560000 00000100:00100000:0.0:1789129226.255284:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604560000 00000100:00100000:0.0:1789129226.255360:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:0.0:1789129226.255372:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11741:x1876037604560000:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789129226.255440:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129226.255476:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab53 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.255500:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:0.0:1789129226.255506:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129226.255561:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.255580:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.255593:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129226.255983:0:5842:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b24aec3b reply state 000000002f31e54a transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.255995:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789129226.256124:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11741:x1876037604560000:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 751us (1023us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789129226.256132:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 184 00000100:00100000:1.0:1789129226.260974:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129226.261238:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604560128 00000100:00100000:3.0:1789129226.261251:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604560128 00000100:00100000:3.0:1789129226.261323:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:3.0:1789129226.261337:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604560128:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1789129226.261828:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.261845:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.261854:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.261860:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129226.261866:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.261875:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.261898:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:0.0:1789129226.261914:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129226.261922:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.261929:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363000/0x5c74554e47ce4f2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789129226.262420:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789129226.262426:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789129225 -> 1789129224 00002000:00010000:3.0:1789129226.262428:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789129222 00002000:00010000:3.0:1789129226.262430:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789129225 -> 1789129224 00002000:00010000:3.0:1789129226.262440:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789129226.262576:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e47840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2370:x1876037604560128:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 1238us (1616us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789129226.262587:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1789129226.279319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129226.279372:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604560384 00000100:00100000:0.0:1789129226.279385:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604560384 00000100:00100000:0.0:1789129226.279452:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:0.0:1789129226.279465:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11741:x1876037604560384:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789129226.279563:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.279586:0:12509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab45 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.279599:0:12509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.279672:0:12509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab45 expref: 18 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.279690:0:12509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab45 expref: 18 pid: 6710 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.279720:0:12509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fb840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12509:1876037626581120:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129226.279840:0:12509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4881ce780 going to sleep for 11 seconds 00000100:00100000:1.0:1789129226.283150:0:12509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fb840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12509:1876037626581120:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129226.283196:0:12509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.285068:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129226.285677:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604560512 00000100:00100000:1.0:1789129226.285693:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604560512 00010000:00010000:1.0:1789129226.285774:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab45 expref: 19 pid: 6710 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129226.285834:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 76 00000100:00100000:1.0:1789129226.285863:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:2370:x1876037604560512:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129226.285884:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129226.285893:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab45 expref: 19 pid: 6710 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.285909:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab45 expref: 19 pid: 6710 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.285940:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362000/0x5c74554e47ce4efb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab45 expref: 19 pid: 6710 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.285961:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:1.0:1789129226.285966:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.285978:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.285986:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.286019:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129226.286095:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:2370:x1876037604560512:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 234us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129226.286103:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 76 00010000:00010000:0.0:1789129226.286304:0:12509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.286313:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.286346:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.286352:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.286358:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.286363:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129226.286367:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.286375:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.286384:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:0.0:1789129226.286387:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789129226.286390:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.286396:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.286439:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:11741:x1876037604560384:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 6977us (7133us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789129226.286460:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 185 00000100:00100000:1.0:1789129226.302927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129226.303153:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604560640 00000100:00100000:0.0:1789129226.303171:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604560640 00000100:00100000:0.0:1789129226.303297:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1789129226.303312:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2370:x1876037604560640:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789129226.303387:0:12455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.303411:0:12455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.303421:0:12455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129226.303426:0:12455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789129226.303432:0:12455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.303477:0:12455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.303492:0:12455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 8 pid: 6689 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.303510:0:12455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79f8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12455:1876037626581248:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129226.303642:0:12455:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4881ce780 going to sleep for 11 seconds 00000100:00100000:3.0:1789129226.308894:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129226.309031:0:12455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79f8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12455:1876037626581248:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129226.309079:0:12455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.309122:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604560768 00000100:00100000:0.0:1789129226.309130:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604560768 00010000:00010000:0.0:1789129226.309173:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 9 pid: 6689 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.309226:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789129226.309237:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2369:x1876037604560768:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129226.309256:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129226.309283:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 9 pid: 6689 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309297:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 9 pid: 6689 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309324:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ebb2f0f/0x5c74554e47ce4f25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab61 expref: 9 pid: 6689 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309344:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789129226.309348:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789129226.309354:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309365:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309397:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129226.309460:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604560768:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 224us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129226.309468:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00010000:00010000:0.0:1789129226.309491:0:12455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309500:0:12455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309528:0:12455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309537:0:12455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309544:0:12455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309551:0:12455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129226.309555:0:12455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309564:0:12455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309586:0:12455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.309594:0:12455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce4f3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.309674:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604560640:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 6366us (6768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129226.309683:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1789129226.321124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129226.321828:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604561024 00000100:00100000:1.0:1789129226.321843:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604561024 00000100:00100000:1.0:1789129226.321932:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 186 00000100:00100000:1.0:1789129226.321953:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+17:11741:x1876037604561024:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789129226.322059:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.322083:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.322099:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.322366:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.322807:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4f09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab4c expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.322817:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.322865:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab4c expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.322884:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4f09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab4c expref: 18 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129226.322902:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e46580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626581376:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129226.323026:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789129226.331784:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e46580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626581376:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129226.331834:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789129226.334671:0:12898:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129226.334687:0:12898:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129226.334986:0:12898:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789129226.334993:0:12898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789129226.338592:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129226.338670:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604561152 00000100:00100000:0.0:1789129226.338681:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604561152 00010000:00010000:0.0:1789129226.338753:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4f09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab4c expref: 19 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.338803:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:0.0:1789129226.338815:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:2370:x1876037604561152:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129226.338834:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129226.338843:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4f09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab4c expref: 19 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.338858:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab4c expref: 19 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.338907:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce4f09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab4c expref: 19 pid: 5842 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.338926:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:0.0:1789129226.338933:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.338945:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.338953:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.338983:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129226.339051:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:2370:x1876037604561152:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 239us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129226.339060:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00010000:00010000:0.0:1789129226.339089:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.339097:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789129226.339367:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1789129226.339539:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1789129226.339590:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1789129226.339721:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1876037626581504:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789129226.339813:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129226.339853:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4881ce780 going to sleep for 11 seconds 00000100:00100000:0.0:1789129226.339996:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626581504 00000100:00100000:0.0:1789129226.340003:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626581504 00000100:00100000:0.0:1789129226.340045:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789129226.340053:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6710:x1876037626581504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789129226.340139:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6710:x1876037626581504:12345-0@lo:1000:mdt00_003.0 Request processed in 85us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129226.340147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789129226.340196:0:6710:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1789129226.340202:0:6710:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b383e470c0, transno 4294967315 00000100:00100000:0.0:1789129226.340218:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1876037626581504:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789129226.340856:0:6710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789129226.340936:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1876037626581632:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789129226.340983:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129226.341008:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b482ba53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129226.341233:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626581632 00000100:00100000:0.0:1789129226.341239:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626581632 00000100:00100000:0.0:1789129226.341272:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789129226.341279:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6710:x1876037626581632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789129226.341501:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6710:x1876037626581632:12345-0@lo:1000:mdt00_003.0 Request processed in 221us (517us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789129226.341509:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789129226.341556:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6710:1876037626581632:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789129226.341592:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.341628:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.341650:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.341656:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129226.341661:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.341670:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.341690:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:0.0:1789129226.341694:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129226.341700:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.341708:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4f48 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.347536:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce4e7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.347562:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce4e7d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.347571:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce4e7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.347577:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129226.347582:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce4e7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.347860:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce4e7d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.347887:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b48544d700) 00010000:00010000:0.0:1789129226.347890:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129226.347897:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce4e7d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.347905:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce4e7d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.347946:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.347966:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab30 expref: 21 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.347978:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.348034:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab30 expref: 21 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.348052:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab30 expref: 21 pid: 12509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.348072:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626581760:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129226.348195:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48246d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789129226.354632:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129226.354690:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604561280 00000100:00100000:3.0:1789129226.355789:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626581760:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129226.355826:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.356182:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604561280 00010000:00010000:0.0:1789129226.356236:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab30 expref: 22 pid: 12509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129226.356290:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:0.0:1789129226.356301:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:2369:x1876037604561280:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129226.356319:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129226.356326:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab30 expref: 22 pid: 12509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.356340:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab30 expref: 22 pid: 12509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.356368:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea600/0x5c74554e47ce4e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab30 expref: 22 pid: 12509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.356382:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b48544d700) 00010000:00010000:0.0:1789129226.356387:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.356399:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.356408:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129226.356435:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129226.356502:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:2369:x1876037604561280:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 201us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129226.356519:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00010000:00010000:2.0:1789129226.357433:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357447:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357462:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357469:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357475:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357482:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129226.357497:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357507:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357520:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b48544d700) 00010000:00010000:2.0:1789129226.357523:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129226.357526:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357533:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce4f4f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357546:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357553:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357558:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357562:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129226.357565:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357570:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357576:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b48544d700) 00010000:00010000:2.0:1789129226.357578:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789129226.357586:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129226.357591:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129226.358012:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11741:x1876037604561024:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 36058us (36898us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789129226.358023:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 186 00000020:00080000:2.0:1789129226.358029:0:6710:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789129226.358171:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789129226.358176:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789129226.361811:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789129226.361837:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789129226.369958:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129226.370055:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604561536 00000100:00100000:1.0:1789129226.370071:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604561536 00000100:00100000:1.0:1789129226.370156:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:1.0:1789129226.370188:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486151c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11741:x1876037604561536:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789129226.371127:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789129226.371256:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1789129226.371319:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.371342:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.371356:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.371367:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.371372:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.371379:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129226.371413:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789129226.371541:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486151c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:11741:x1876037604561536:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1354us (1601us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1789129226.371552:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000020:00080000:1.0:1789129226.371559:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789129226.372675:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129226.372689:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129226.372708:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129226.372714:0:8443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129226.372724:0:8443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129226.372752:0:8443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff90b49117b600) 00010000:00010000:3.0:1789129226.372756:0:8443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789129226.372763:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129226.372789:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129226.372815:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129226.372817:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129226.372818:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129226.441134:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129226.502247:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789129226.502283:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626581888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129226.502392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129226.502583:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626581888 00000100:00100000:0.0:1789129226.502594:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626581888 00000100:00100000:0.0:1789129226.502698:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789129226.502711:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626581888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129226.503244:0:6690:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129226.503342:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626581888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 633us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129226.503354:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789129226.503556:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626581888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789129227.466886:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789129227.612050:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1789129227.612097:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1789129227.612117:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:1.0:1789129228.039258:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789129228.039293:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626582016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129228.040121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129228.043591:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382100780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626582272:0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.043752:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129228.043841:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789129228.043848:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626582144:0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.043900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129228.043924:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626582656:0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.043950:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129228.043981:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626582528:0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.044014:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129228.044037:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789129228.044044:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626582400:0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.044090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129228.044133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626582144 00000100:00100000:0.0:1789129228.044144:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626582144 00000100:00100000:0.0:1789129228.044208:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789129228.044221:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626582144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.044300:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626582144:12345-0@lo:400:kworker.0 Request processed in 80us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129228.044310:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789129228.044356:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626582272 00000100:00100000:0.0:1789129228.044361:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626582272 00000100:00100000:0.0:1789129228.044391:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626582656 00000100:00100000:0.0:1789129228.044394:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626582656 00000100:00100000:0.0:1789129228.044429:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626582400 00000100:00100000:0.0:1789129228.044432:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626582400 00000100:00100000:0.0:1789129228.044453:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789129228.044460:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626582272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.044498:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626582272:12345-0@lo:400:kworker.0 Request processed in 38us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129228.044506:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789129228.044517:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789129228.044523:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626582656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.044549:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626582656:12345-0@lo:400:kworker.0 Request processed in 27us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129228.044554:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789129228.044565:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789129228.044570:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626582400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.044636:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626582400:12345-0@lo:400:kworker.0 Request processed in 65us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129228.044642:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789129228.044664:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626582528 00000100:00100000:0.0:1789129228.044667:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626582528 00000100:00100000:0.0:1789129228.044698:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789129228.044725:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626582528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.044761:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b53c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626582528:12345-0@lo:400:kworker.0 Request processed in 50us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129228.044768:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789129228.044836:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626582144:0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.044860:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b23c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626582656:0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.044873:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382100780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626582272:0@lo:400:kworker.0 00000100:00080000:0.0:1789129228.044919:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789129228.044926:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129228.044950:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382103480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626582400:0@lo:400:kworker.0 00000100:00100000:0.0:1789129228.044960:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1789129228.044971:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1789129228.044991:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4bae7b480, transno 4294967307 00000100:00100000:0.0:1789129228.045005:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382101680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626582528:0@lo:400:kworker.0 00000100:00100000:3.0:1789129228.046250:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626582016 00000100:00100000:3.0:1789129228.046266:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626582016 00000100:00100000:3.0:1789129228.046359:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789129228.046374:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626582016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789129228.046430:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129228.046536:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e452c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626582016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (6419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129228.046545:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789129228.046673:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e47c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626582016:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789129228.047091:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789129228.485942:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789129228.920278:0:12954:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129228.920292:0:12954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129228.920337:0:12954:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789129228.920345:0:12954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789129229.101200:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129229.101453:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604561792 00000100:00100000:1.0:1789129229.101467:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604561792 00000100:00100000:1.0:1789129229.101570:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:1.0:1789129229.101582:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:11759:x1876037604561792:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129229.101658:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129229.101688:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab68 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.102216:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.102236:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.102251:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129229.102265:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000100:00080000:2.0:1789129229.103178:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789129229.103223:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4f5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab68 expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.103253:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab68 expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.103264:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789129229.103267:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789129229.103272:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86400, rc 0) 00000100:00100000:1.0:1789129229.103366:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11759:x1876037604561792:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1785us (2179us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789129229.103375:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 187 00000100:00100000:0.0:1789129229.107676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129229.108590:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604561920 00000100:00100000:2.0:1789129229.108631:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604561920 00000100:00100000:2.0:1789129229.108851:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 188 00000100:00100000:2.0:1789129229.108865:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11759:x1876037604561920:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:2.0:1789129229.108968:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4f72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.108994:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4f72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.109010:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4f72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.109037:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce4f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.109045:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce4f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.109053:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce4f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111137:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111166:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111181:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789129229.111253:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111270:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4f72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111277:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4f72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111285:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4f72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111292:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eba00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129229.111297:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4f72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111310:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4f72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111326:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:2.0:1789129229.111329:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129229.111335:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4f72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111342:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce4f72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111356:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce4f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111362:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce4f79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111368:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce4f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111372:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129229.111374:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce4f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111380:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce4f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111387:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b48544d000) 00010000:00010000:2.0:1789129229.111389:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129229.111392:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce4f79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111408:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea800/0x5c74554e47ce4f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111425:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111432:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111438:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111444:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129229.111446:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111452:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111461:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b48544d700) 00010000:00010000:2.0:1789129229.111463:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129229.111467:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.111473:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4f80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129229.111619:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11759:x1876037604561920:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 2733us (3931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129229.111633:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 188 00000100:00100000:0.0:1789129229.217997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129229.218351:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604562176 00000100:00100000:3.0:1789129229.218376:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604562176 00000100:00100000:3.0:1789129229.218443:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:3.0:1789129229.218456:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11762:x1876037604562176:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129229.218490:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129229.218526:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab6f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.218864:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4f8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.218885:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.218899:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.218921:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.218929:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.218937:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.219875:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.219890:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.219901:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129229.219925:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789129229.220857:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4f8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.220873:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4f8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.220881:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4f8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.220888:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129229.220893:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4f8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.220902:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4f8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.220924:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129229.220928:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129229.220935:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4f8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.220942:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3800/0x5c74554e47ce4f8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.220969:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.220977:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4f95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.221194:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.221200:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129229.221203:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.221211:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.221220:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4909bd800) 00010000:00010000:3.0:1789129229.221223:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129229.221226:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4f95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.221232:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.221311:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab6f expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.221407:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab6f expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.221416:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:3.0:1789129229.221418:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129229.221421:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3e00, rc 0) 00000100:00100000:3.0:1789129229.221620:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:11762:x1876037604562176:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 3146us (3633us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789129229.221652:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 189 00000100:00100000:1.0:1789129229.237511:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129229.240371:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604562304 00000100:00100000:2.0:1789129229.240398:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604562304 00000100:00100000:2.0:1789129229.240520:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:2.0:1789129229.240536:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:11762:x1876037604562304:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:2.0:1789129229.240682:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4faa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.240721:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.244169:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.244250:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.244259:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4faa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.244268:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.244276:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129229.244294:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.244304:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4faa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.244327:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:2.0:1789129229.244331:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789129229.244336:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4faa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.244354:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce4faa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129229.244493:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:11762:x1876037604562304:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 3953us (7002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129229.244507:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 190 00000100:00100000:3.0:1789129229.251839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129229.252048:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604562560 00000100:00100000:0.0:1789129229.252066:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604562560 00000100:00100000:0.0:1789129229.252201:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:0.0:1789129229.252217:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:11762:x1876037604562560:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129229.252639:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:11762:x1876037604562560:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 423us (821us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789129229.252660:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:0.0:1789129229.360246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129229.360303:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604562816 00000100:00100000:0.0:1789129229.360316:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604562816 00000100:00100000:0.0:1789129229.360813:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:0.0:1789129229.360829:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:11288:x1876037604562816:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789129229.360871:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129229.360901:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4fb1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab76 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.361037:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.361067:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab6f expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.361077:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.361121:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab6f expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.361135:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab6f expref: 28 pid: 5840 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129229.361436:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e503c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626582784:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129229.362125:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48557a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129229.372826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129229.372887:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604562944 00000100:00100000:2.0:1789129229.372905:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604562944 00010000:00010000:2.0:1789129229.372985:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab6f expref: 29 pid: 5840 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129229.374254:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:3.0:1789129229.383304:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e503c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626582784:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129229.383580:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129229.387567:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+29:2369:x1876037604562944:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129229.388769:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129229.388803:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab6f expref: 29 pid: 5840 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.388836:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab6f expref: 29 pid: 5840 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.388872:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4f9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab6f expref: 29 pid: 5840 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.388896:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:2.0:1789129229.388902:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.388930:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.388944:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.389006:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129229.389464:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129229.389480:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e53c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:2369:x1876037604562944:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 15196us (16663us total) trans 0 rc 0/0 00010000:00010000:1.0:1789129229.389487:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129229.389507:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000004:00200000:1.0:1789129229.390658:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789129229.390967:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce4fb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab76 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.391000:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab76 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.391012:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:1.0:1789129229.391015:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789129229.391019:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363e00, rc 0) 00000100:00100000:1.0:1789129229.393359:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:11288:x1876037604562816:12345-192.168.201.39@tcp:101:bash.0 Request processed in 32518us (33112us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789129229.393377:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 191 00000100:00100000:0.0:1789129229.414139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129229.414917:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604563200 00000100:00100000:3.0:1789129229.414939:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604563200 00000100:00100000:3.0:1789129229.415037:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 192 00000100:00100000:3.0:1789129229.415053:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:11288:x1876037604563200:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:3.0:1789129229.415540:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.415570:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.415588:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789129229.415699:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1789129229.415731:0:5840:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b36be169 reply state 000000003c386860 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129229.415745:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789129229.415801:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1789129229.415982:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:11288:x1876037604563200:12345-192.168.201.39@tcp:36:bash.0 Request processed in 930us (1858us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1789129229.415992:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 192 00000020:00080000:3.0:1789129229.416001:0:5840:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789129229.422477:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129229.422702:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604563328 00000100:00100000:3.0:1789129229.422718:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604563328 00000100:00100000:3.0:1789129229.422800:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:3.0:1789129229.422814:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:11288:x1876037604563328:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129229.422854:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129229.422888:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4fcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.422986:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4fcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab7d expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.423008:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4fcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab7d expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.423041:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.423788:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.423804:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.425760:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:3.0:1789129229.425779:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789129229.425789:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3200, rc 0) 00000100:00100000:3.0:1789129229.425933:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+33:11288:x1876037604563328:12345-192.168.201.39@tcp:101:bash.0 Request processed in 3112us (3464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129229.425947:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 193 00000100:00100000:3.0:1789129229.430680:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129229.430767:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604563456 00000100:00100000:3.0:1789129229.430785:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604563456 00000100:00100000:3.0:1789129229.430902:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:3.0:1789129229.430920:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:11288:x1876037604563456:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129229.430960:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129229.431012:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4fd4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab84 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789129229.431069:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3f208, atime: 0x6aa3f206, ctime: 0x6aa3f208, blocks: 0xb 00010000:00010000:3.0:1789129229.431110:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=392s v=(0 0) 00010000:00010000:3.0:1789129229.431117:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129229.431131:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab84 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.432672:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab84 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.432706:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3800, rc 0) 00000100:00100000:3.0:1789129229.432854:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:11288:x1876037604563456:12345-192.168.201.39@tcp:101:bash.0 Request processed in 1937us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129229.432865:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00080000:3.0:1789129229.432921:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789129229.434248:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129229.434271:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.434287:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.434308:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:0.0:1789129229.434312:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129229.434318:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.434325:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4fc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129229.445523:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129229.445899:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604563584 00000100:00100000:1.0:1789129229.445911:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604563584 00002000:00010000:1.0:1789129229.445955:0:6693:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789129229.445960:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4b5af5a40 with x1876037604563584 ext(0->18446744073709551615) 00002000:00010000:1.0:1789129229.445972:0:6693:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4b5af5a40. 00000100:00100000:1.0:1789129229.446001:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1789129229.446011:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604563584:12345-192.168.201.39@tcp:10:bash.0 00002000:00010000:1.0:1789129229.447324:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789129229.447349:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789129224 -> 1789129229 00002000:00010000:1.0:1789129229.447354:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789129222 -> 1789129222 00002000:00010000:1.0:1789129229.447357:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789129224 -> 1789129229 00002000:00010000:1.0:1789129229.447359:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789129229.447465:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2369:x1876037604563584:12345-192.168.201.39@tcp:10:bash.0 Request processed in 1450us (1948us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789129229.447476:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00002000:00010000:1.0:1789129229.447482:0:6693:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789129229.447486:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4b5af5a40 with x1876037604563584 ext(0->18446744073709551615) 00002000:00010000:1.0:1789129229.447493:0:6693:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4b5af5a40. 00000040:00080000:0.0:1789129229.447950:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789129229.447956:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789129229.448028:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789129229.448045:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789129229.513516:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129229.610800:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129229.611105:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604563712 00000100:00100000:1.0:1789129229.611121:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604563712 00000100:00100000:1.0:1789129229.611215:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:1.0:1789129229.611229:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:11776:x1876037604563712:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:1.0:1789129229.611347:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4fdb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.611390:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4fdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.611407:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4fdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.611428:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4fe2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.611436:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.611443:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613238:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613266:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613281:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789129229.613356:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613372:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4fdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613380:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4fdb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613388:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4fdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613395:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129229.613400:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4fdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613408:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4fdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613427:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789129229.613432:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129229.613440:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4fdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613474:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce4fdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613495:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4fe2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613504:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4fe2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613512:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613517:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129229.613521:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4fe2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613528:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4fe2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613537:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b49117be00) 00010000:00010000:1.0:1789129229.613541:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129229.613545:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4fe2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613552:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce4fe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613574:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613581:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613596:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613697:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129229.613701:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613709:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613719:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:1.0:1789129229.613723:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129229.613726:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.613733:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce4fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129229.614346:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:11776:x1876037604563712:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 3111us (3562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129229.614362:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 194 00000100:00100000:0.0:1789129229.720379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129229.720502:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604563968 00000100:00100000:3.0:1789129229.720515:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604563968 00000100:00100000:3.0:1789129229.720634:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:3.0:1789129229.720649:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+32:11779:x1876037604563968:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129229.720680:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129229.720719:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce4ff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab8b expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.720822:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4ff7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.720864:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.720880:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.720900:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4ffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.720907:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.720913:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721360:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce5005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721371:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce5005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721378:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce5005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129229.721390:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789129229.721523:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721533:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4ff7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721540:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721553:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129229.721558:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721567:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4ff7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721584:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129229.721587:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129229.721593:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4ff7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721638:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce4ff7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721655:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4ffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721661:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4ffe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721667:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721672:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129229.721675:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4ffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721681:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4ffe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721713:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4909bd300) 00010000:00010000:3.0:1789129229.721715:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129229.721719:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4ffe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721725:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3e00/0x5c74554e47ce4ffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721780:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce4ff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab8b expref: 35 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721797:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce5005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab8b expref: 34 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.721805:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:3.0:1789129229.721808:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789129229.721810:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3400, rc 0) 00000100:00100000:3.0:1789129229.721908:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:11779:x1876037604563968:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1262us (1559us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789129229.721918:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:2.0:1789129229.732236:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129229.732699:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604564096 00000100:00100000:3.0:1789129229.732718:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604564096 00000100:00100000:3.0:1789129229.732834:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:3.0:1789129229.732849:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:11779:x1876037604564096:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:3.0:1789129229.732970:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.732997:0:12509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab76 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.733028:0:12509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.733093:0:12509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab76 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129229.733113:0:12509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab76 expref: 34 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129229.733134:0:12509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383d70b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12509:1876037626582912:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129229.733299:0:12509:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44000 going to sleep for 11 seconds 00000100:00100000:1.0:1789129229.741300:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129229.741510:0:12509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383d70b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12509:1876037626582912:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129229.741557:0:12509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129229.758389:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604564352 00000100:00100000:0.0:1789129229.758413:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604564352 00000100:00100000:0.0:1789129229.758519:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:0.0:1789129229.758532:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:5610:x1876037604564352:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789129229.761304:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+36:5610:x1876037604564352:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 2750us (20002us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789129229.761326:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:1.0:1789129229.781984:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129229.782277:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604564480 00000100:00100000:0.0:1789129229.782295:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604564480 00010000:00010000:0.0:1789129229.782373:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab76 expref: 36 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129229.782432:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:0.0:1789129229.782456:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+36:2370:x1876037604564480:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129229.782484:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129229.782494:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab76 expref: 36 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.782514:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab76 expref: 36 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.782552:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce4fb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab76 expref: 36 pid: 5842 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.782578:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:0.0:1789129229.782585:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.782859:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.782874:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.782967:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129229.783581:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e45a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:2370:x1876037604564480:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1127us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129229.783597:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00010000:00010000:1.0:1789129229.783785:0:12509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.783798:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.783850:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.783872:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.783881:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.783889:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129229.783897:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.783907:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.783938:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:1.0:1789129229.783942:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789129229.783947:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.783956:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2a00/0x5c74554e47ce5013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129229.784036:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:11779:x1876037604564096:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 51190us (51827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129229.784181:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 196 00000100:00100000:2.0:1789129229.789536:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129229.789897:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604564736 00000100:00100000:1.0:1789129229.789930:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604564736 00000100:00100000:1.0:1789129229.790033:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:1.0:1789129229.790506:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+34:11779:x1876037604564736:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:1.0:1789129229.791032:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:11779:x1876037604564736:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 980us (1511us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789129229.798113:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:2.0:1789129229.969474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129229.969672:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604564992 00000100:00100000:1.0:1789129229.969697:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604564992 00000100:00100000:1.0:1789129229.969796:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:1.0:1789129229.969812:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+35:11790:x1876037604564992:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:1.0:1789129229.969857:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129229.969900:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce501a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab92 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970015:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5021 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970037:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5021 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970059:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5021 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970081:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5028 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970088:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970095:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970675:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce502f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970718:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce502f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970730:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce502f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129229.970745:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789129229.970904:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5021 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970914:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5021 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970922:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5021 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970931:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129229.970937:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5021 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970948:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5021 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970966:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789129229.970970:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129229.970977:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5021 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.970985:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5021 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.971003:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.971019:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5028 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.971026:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.971032:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129229.971035:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.971043:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.971053:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b49117be00) 00010000:00010000:1.0:1789129229.971056:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129229.971059:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5028 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.971067:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5028 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.971134:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce501a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab92 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.971153:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce502f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab92 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129229.971162:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:1.0:1789129229.971165:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789129229.971175:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87400, rc 0) 00000100:00100000:1.0:1789129229.971299:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:11790:x1876037604564992:12345-192.168.201.39@tcp:101:cat.0 Request processed in 1490us (1852us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789129229.971310:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 197 00000100:00100000:1.0:1789129229.978038:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129229.978135:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604565248 00000100:00100000:0.0:1789129229.978156:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604565248 00000100:00100000:0.0:1789129229.978317:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:0.0:1789129229.978334:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:11790:x1876037604565248:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:0.0:1789129229.978830:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e45e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:11790:x1876037604565248:12345-192.168.201.39@tcp:35:cat.0 Request processed in 498us (808us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789129229.978842:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 54 00000100:00100000:2.0:1789129229.992783:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129229.995240:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604565504 00000100:00100000:0.0:1789129229.995271:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604565504 00000100:00100000:0.0:1789129229.995414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 198 00000100:00100000:0.0:1789129229.995432:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:11791:x1876037604565504:12345-192.168.201.39@tcp:36:rm.0 00010000:00010000:0.0:1789129229.995530:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789129229.995578:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce502f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab92 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.995644:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3400/0x5c74554e47ce5005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab8b expref: 37 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.995662:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3200/0x5c74554e47ce4fcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab7d expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.995674:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4909bde00) 00010000:00010000:0.0:1789129229.995722:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129229.995767:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce503d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.995786:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce503d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.995822:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce503d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.995843:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.995851:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.995859:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.996343:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce504b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.996356:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce504b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.996364:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce504b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789129229.997230:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789129229.997245:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393094642538ns, next at 394094638811ns, rc = 0 00010000:00010000:0.0:1789129229.997343:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997371:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997383:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997393:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997401:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997409:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997445:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789129229.997477:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce504b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997485:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce504b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997493:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce504b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997500:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129229.997506:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce504b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997515:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce504b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997541:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:0.0:1789129229.997545:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789129229.997551:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce504b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997557:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce504b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997581:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce503d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997587:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce503d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997593:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce503d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997598:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129229.997643:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce503d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997650:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce503d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997658:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129229.997661:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129229.997664:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce503d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129229.997670:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce503d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129229.997703:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b3e5bf81 reply state 00000000204314d6 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129229.997714:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789129229.997851:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+37:11791:x1876037604565504:12345-192.168.201.39@tcp:36:rm.0 Request processed in 2418us (5084us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789129229.997864:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 198 00010000:00010000:2.0:1789129229.998058:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129229.998068:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.998077:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129229.998081:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.998087:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.998098:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90b4976b8100) 00010000:00010000:2.0:1789129229.998108:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789129229.998112:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.998119:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362a00/0x5c74554e47ce5052 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129229.998138:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129229.998140:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129229.998142:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129230.005221:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.005258:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.005269:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.005277:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129230.005284:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.005296:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.005327:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4976b8600) 00010000:00010000:0.0:1789129230.005331:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129230.005340:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.005348:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5044 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129230.054132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129230.054213:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604565760 00000100:00100000:1.0:1789129230.054228:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604565760 00000100:00100000:1.0:1789129230.054565:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:1.0:1789129230.054579:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+36:11797:x1876037604565760:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789129230.054675:0:12509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129230.054726:0:12509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5059 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aab99 expref: -99 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.054981:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5060 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.055004:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5060 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.055019:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5060 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.055039:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.055047:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.055054:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789129230.057279:0:12509:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789129230.057913:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.057939:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.057953:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.058007:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5060 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.058016:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5060 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.058024:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5060 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.058032:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129230.058037:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5060 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.058046:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5060 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.058066:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789129230.058069:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129230.058076:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5060 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.058099:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5060 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789129230.058119:0:12509:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009a3fecdb reply state 0000000012b15bea transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129230.058132:0:12509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789129230.058183:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce5059 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab99 expref: 39 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.058204:0:12509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab99 expref: 38 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.058213:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b49117bb00) 00010000:00010000:1.0:1789129230.058216:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789129230.058220:0:12509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87a00, rc 0) 00000100:00100000:1.0:1789129230.059101:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+39:11797:x1876037604565760:12345-192.168.201.39@tcp:101:bash.0 Request processed in 4517us (4978us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789129230.059116:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:2.0:1789129230.070247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129230.070398:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604565888 00000100:00100000:1.0:1789129230.070414:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604565888 00010000:00010000:0.0:1789129230.070456:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.070473:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.070482:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.070490:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129230.070496:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.070507:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129230.070530:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00010000:00010000:0.0:1789129230.070533:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b49117be00) 00010000:00010000:0.0:1789129230.070536:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789129230.070543:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2370:x1876037604565888:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:0.0:1789129230.070544:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.070551:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5067 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.070571:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129230.070597:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78ff418/0x5c74554e47ce507c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaba0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789129230.070713:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129230.070756:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1789129230.070761:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129230.070775:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78ff418/0x5c74554e47ce507c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba0 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.070800:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a78ff418/0x5c74554e47ce507c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba0 expref: 6 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.070817:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b87c00, rc 0) 00000100:00100000:1.0:1789129230.070915:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2370:x1876037604565888:12345-192.168.201.39@tcp:101:bash.0 Request processed in 374us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129230.070924:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00080000:3.0:1789129230.071504:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129230.092195:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.092385:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604566016 00000100:00100000:3.0:1789129230.092402:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604566016 00000100:00100000:3.0:1789129230.092496:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:3.0:1789129230.092510:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:11797:x1876037604566016:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129230.092537:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129230.092565:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aaba7 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.092671:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a78ff418/0x5c74554e47ce507c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba0 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.092722:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129230.092727:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129230.092734:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.092793:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a78ff418/0x5c74554e47ce507c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba0 expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.092812:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a78ff418/0x5c74554e47ce507c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba0 expref: 7 pid: 6689 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.092832:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383d70b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876037626583040:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129230.093461:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44000 going to sleep for 11 seconds 00000100:00100000:2.0:1789129230.105963:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.106741:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604566144 00000100:00100000:3.0:1789129230.106757:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604566144 00010000:00010000:3.0:1789129230.106828:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a78ff418/0x5c74554e47ce507c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba0 expref: 8 pid: 6689 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.106887:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:3.0:1789129230.106898:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604566144:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129230.106929:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129230.106961:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a78ff418/0x5c74554e47ce507c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba0 expref: 8 pid: 6689 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.106977:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a78ff418/0x5c74554e47ce507c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba0 expref: 8 pid: 6689 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.107031:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129230.107036:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129230.107059:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.107073:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.107123:0:8444:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.107142:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383d730c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1876037626583168:192.168.201.39@tcp:105: 00000100:00100000:3.0:1789129230.107264:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44c00 going to sleep for 11 seconds 00010000:00010000:0.0:1789129230.107962:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78ff418/0x5c74554e47ce507c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba0 expref: 8 pid: 6689 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129230.107988:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383d70b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6686:1876037626583040:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129230.108025:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 7 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.108120:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3e00, rc 0) 00000100:00100000:0.0:1789129230.108173:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:11797:x1876037604566016:12345-192.168.201.39@tcp:101:bash.0 Request processed in 15665us (15992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129230.108184:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1789129230.130562:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129230.130779:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604566400 00000100:00100000:0.0:1789129230.130790:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604566400 00000100:00100000:3.0:1789129230.130803:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383d730c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8444:1876037626583168:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789129230.130842:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129230.130872:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:0.0:1789129230.130884:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+38:11797:x1876037604566400:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:3.0:1789129230.130920:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2369:x1876037604566144:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 24024us (24976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129230.130931:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:0.0:1789129230.131357:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+39:11797:x1876037604566400:12345-192.168.201.39@tcp:35:bash.0 Request processed in 473us (811us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789129230.131366:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 55 00000100:00100000:1.0:1789129230.308324:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.310652:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604566528 00000100:00100000:3.0:1789129230.310683:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604566528 00000100:00100000:3.0:1789129230.310787:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:3.0:1789129230.310801:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+39:11813:x1876037604566528:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129230.310839:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129230.310872:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce508a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabae expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.310964:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.310983:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.310996:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129230.311080:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1789129230.311083:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129230.311103:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.311125:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce508a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabae expref: 41 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.311144:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabae expref: 40 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.311152:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129230.311154:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789129230.311157:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3c00, rc 0) 00000100:00100000:3.0:1789129230.311388:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+40:11813:x1876037604566528:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 588us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129230.311396:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:2.0:1789129230.319101:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129230.319219:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604566784 00000100:00100000:0.0:1789129230.319234:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604566784 00000100:00100000:0.0:1789129230.319317:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:0.0:1789129230.319331:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+40:11813:x1876037604566784:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129230.319363:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129230.319395:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5098 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabb5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.319518:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce509f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.319533:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce509f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.319543:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce509f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129230.319568:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789129230.319777:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce5098 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabb5 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.319805:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce509f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabb5 expref: 42 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.319813:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b49117bb00) 00010000:00010000:0.0:1789129230.319816:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129230.319819:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363e00, rc 0) 00000100:00100000:0.0:1789129230.319897:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+42:11813:x1876037604566784:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 571us (816us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789129230.319903:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 201 00000100:00100000:1.0:1789129230.323221:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.323521:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604567040 00000100:00100000:3.0:1789129230.323535:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604567040 00000100:00100000:3.0:1789129230.323719:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 202 00000100:00100000:3.0:1789129230.323732:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+42:11813:x1876037604567040:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129230.323766:0:12509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129230.323798:0:12509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabbc expref: -99 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.323929:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce50b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.323949:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce50b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.323964:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce50b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129230.323977:0:12509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789129230.324117:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabbc expref: 45 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.324133:0:12509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce50b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabbc expref: 44 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.324140:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b49117bb00) 00010000:00010000:3.0:1789129230.324143:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789129230.324145:0:12509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2000, rc 0) 00000100:00100000:3.0:1789129230.324211:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+44:11813:x1876037604567040:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 483us (1009us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789129230.324216:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 202 00000100:00100000:1.0:1789129230.324365:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.324588:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604567168 00000100:00100000:3.0:1789129230.324852:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604567168 00000100:00100000:3.0:1789129230.324913:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:3.0:1789129230.324921:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+44:2369:x1876037604567168:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129230.324951:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129230.324974:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363e00/0x5c74554e47ce509f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabb5 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.324989:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b49117bb00) 00010000:00010000:3.0:1789129230.324993:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129230.325041:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+43:2369:x1876037604567168:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 120us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129230.325049:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789129230.333186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129230.333317:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604567296 00000100:00100000:2.0:1789129230.333334:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604567296 00000100:00100000:2.0:1789129230.333428:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:2.0:1789129230.333444:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+6:2367:x1876037604567296:12345-192.168.201.39@tcp:1:lfs.0 00010000:00010000:2.0:1789129230.333531:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.333565:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.333578:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129230.333584:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789129230.333591:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.333715:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 6 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.333734:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 6 pid: 6686 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129230.333755:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5af7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876037626583296:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129230.333898:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4baf1e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129230.338212:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.339806:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604567424 00000100:00100000:3.0:1789129230.339824:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604567424 00002000:00100000:3.0:1789129230.339908:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff90b4b5af61c0 x1876037604567424/t0(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:456/0 lens 504/0 e 0 to 0 dl 1789129241 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129230.339920:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4b5af61c0 with x1876037604567424 ext(0->8) 00010000:00010000:3.0:1789129230.339932:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 7 pid: 6686 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.339950:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 7 pid: 6686 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789129230.339957:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b4b5af61c0 00000100:00100000:3.0:1789129230.339995:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:3.0:1789129230.340003:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604567424:12345-192.168.201.39@tcp:4:lfs.0 00000100:00100000:3.0:1789129230.340824:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2370:x1876037604567424:12345-192.168.201.39@tcp:4:lfs.0 Request processed in 816us (2619us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789129230.340834:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00002000:00100000:3.0:1789129230.340841:0:6694:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff90b4b5af61c0 x1876037604567424/t4294967308(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:456/0 lens 504/448 e 0 to 0 dl 1789129241 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129230.340848:0:6694:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4b5af61c0 with x1876037604567424 ext(0->8) 00010000:00010000:3.0:1789129230.340855:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 9 pid: 6686 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.340866:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 9 pid: 6686 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789129230.340872:0:6694:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90b4b5af61c0 00000100:00100000:0.0:1789129230.341892:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5af7840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876037626583296:192.168.201.39@tcp:104: 00010000:00010000:0.0:1789129230.341942:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.347081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129230.347210:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604567552 00000100:00100000:2.0:1789129230.347225:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604567552 00010000:00010000:2.0:1789129230.347275:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 9 pid: 6686 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129230.347327:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:2.0:1789129230.347339:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2367:x1876037604567552:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129230.347362:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789129230.347391:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789129230.347395:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789129229 00002000:00010000:2.0:1789129230.347397:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789129230 00002000:00010000:2.0:1789129230.347400:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789129229 00010000:00010000:2.0:1789129230.347407:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 9 pid: 6686 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.347443:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 9 pid: 6686 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.347472:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077875fc0/0x5c74554e47ce5083 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aaba7 expref: 9 pid: 6686 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.347495:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789129230.347500:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789129230.347507:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.347515:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.347551:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129230.347683:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d71a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2367:x1876037604567552:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 335us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129230.347692:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00010000:00010000:0.0:1789129230.347995:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.348007:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.348039:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.348063:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.348072:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.348080:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129230.348085:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.348096:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.348111:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.348118:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034cf15be/0x5c74554e47ce50c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129230.348194:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2367:x1876037604567296:12345-192.168.201.39@tcp:1:lfs.0 Request processed in 14754us (15028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129230.348204:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1789129230.350291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129230.350440:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604567808 00000100:00100000:0.0:1789129230.350457:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604567808 00000100:00100000:0.0:1789129230.350520:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 56 00000100:00100000:0.0:1789129230.350544:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486152850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+43:11813:x1876037604567808:12345-192.168.201.39@tcp:35:lfs.0 00000004:00010000:0.0:1789129230.350928:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce50b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabbc expref: 43 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789129230.351362:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1789129230.351416:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1789129230.352052:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1789129230.352117:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.352137:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab99 expref: 47 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.352166:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.352218:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab99 expref: 47 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.352243:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab99 expref: 47 pid: 12509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129230.352261:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e45a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876037626583424:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129230.352441:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483a24a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789129230.355340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.355583:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604567936 00000100:00100000:3.0:1789129230.355597:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604567936 00000100:00100000:1.0:1789129230.355799:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e45a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5844:1876037626583424:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129230.355839:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.355965:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab99 expref: 48 pid: 12509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.356020:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:3.0:1789129230.356033:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+48:2370:x1876037604567936:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129230.356058:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129230.356066:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab99 expref: 48 pid: 12509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.356105:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab99 expref: 48 pid: 12509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.356143:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce506e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab99 expref: 48 pid: 12509 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.356163:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b49117bb00) 00010000:00010000:3.0:1789129230.356169:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.356180:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.356190:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.356227:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129230.356315:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+47:2370:x1876037604567936:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 284us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129230.356324:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00010000:00010000:2.0:1789129230.356418:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.356427:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789129230.356635:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789129230.357291:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1789129230.357458:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5af70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626583552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789129230.357532:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129230.357575:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4baf1ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129230.357892:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626583552 00000100:00100000:0.0:1789129230.357902:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626583552 00000100:00100000:0.0:1789129230.357969:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789129230.357979:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626583552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789129230.358080:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626583552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129230.358088:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789129230.358138:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129230.358303:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5af70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626583552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789129230.359198:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789129230.359285:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b5af70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626583680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789129230.359340:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129230.359421:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4baf1e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789129230.359462:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626583680 00000100:00100000:0.0:1789129230.359469:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626583680 00000100:00100000:0.0:1789129230.359560:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789129230.359570:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876037626583680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789129230.359824:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1876037626583680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 255us (482us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789129230.359833:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789129230.359914:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b5af70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5844:1876037626583680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789129230.359974:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1789129230.360017:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.360028:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.360037:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.360044:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129230.360049:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.360058:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.360077:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b49117bb00) 00010000:00010000:2.0:1789129230.360080:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789129230.360099:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.360106:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce50c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789129230.360300:0:5844:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789129230.360411:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789129230.360424:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393457821592ns, next at 394457819172ns, rc = 0 00000001:00080000:2.0:1789129230.360431:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789129230.360460:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b49117bb00) 00010000:00010000:2.0:1789129230.360463:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789129230.360471:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2000/0x5c74554e47ce50b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabbc expref: 51 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129230.360585:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486152850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:11813:x1876037604567808:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 10040us (10305us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789129230.360594:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 56 00000020:00080000:2.0:1789129230.360619:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789129230.365869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129230.365926:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129230.365969:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129230.366192:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604568192 00000100:00100000:0.0:1789129230.366207:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604568192 00000100:00100000:0.0:1789129230.366283:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:0.0:1789129230.366296:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2367:x1876037604568192:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129230.366393:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5531c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2367:x1876037604568192:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 100us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129230.366401:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:0.0:1789129230.366590:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604568320 00000100:00100000:0.0:1789129230.366640:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604568320 00000100:00100000:1.0:1789129230.366761:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604568064 00000100:00100000:1.0:1789129230.366766:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604568064 00000100:00100000:1.0:1789129230.366800:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 339 00000100:00100000:1.0:1789129230.366808:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604568064:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129230.366841:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604568064:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 34us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129230.366848:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 339 00000100:00100000:1.0:1789129230.367433:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129230.367809:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604568448 00000100:00100000:0.0:1789129230.367818:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604568448 00000100:00100000:0.0:1789129230.367845:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:0.0:1789129230.367854:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604568320:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129230.367913:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604568320:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 59us (1941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129230.367920:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 195 00000100:00100000:0.0:1789129230.367935:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00100000:0.0:1789129230.367942:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+50:11813:x1876037604568448:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129230.367960:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129230.367991:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce50d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabc3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.368063:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce50d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabc3 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.368081:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce50d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabc3 expref: 51 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.368103:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129230.368107:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129230.368113:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362800, rc 0) 00000100:00100000:0.0:1789129230.368135:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e45a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:11813:x1876037604568448:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 194us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129230.368142:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 203 00000100:00080000:2.0:1789129230.368463:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129230.374846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129230.375012:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604568704 00000100:00100000:0.0:1789129230.375043:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604568704 00000100:00100000:0.0:1789129230.375122:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1789129230.375134:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+51:11813:x1876037604568704:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:0.0:1789129230.375489:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:11813:x1876037604568704:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 356us (658us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1789129230.375499:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 57 00000100:00100000:0.0:1789129230.496944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.497100:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604568832 00000100:00100000:3.0:1789129230.497117:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604568832 00000100:00100000:3.0:1789129230.497316:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:3.0:1789129230.497332:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:11824:x1876037604568832:12345-192.168.201.39@tcp:34:lfs.0 00010000:00010000:3.0:1789129230.497451:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.497502:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.497520:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.497540:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.497548:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.497555:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498110:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498124:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498135:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789129230.498281:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498299:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498306:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498330:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498337:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129230.498343:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498352:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498368:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129230.498372:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129230.498380:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498387:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498406:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498413:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498420:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498426:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129230.498430:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498451:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498460:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4909bd300) 00010000:00010000:3.0:1789129230.498463:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129230.498466:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498473:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498491:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498498:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498505:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498511:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129230.498514:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498521:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498527:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129230.498531:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129230.498534:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.498550:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.498943:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:11824:x1876037604568832:12345-192.168.201.39@tcp:34:lfs.0 Request processed in 1609us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129230.498955:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 204 00010000:00010000:3.0:1789129230.533996:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129230.541985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.542339:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604569088 00000100:00100000:3.0:1789129230.542358:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604569088 00000100:00100000:3.0:1789129230.542445:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:3.0:1789129230.542456:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+52:11827:x1876037604569088:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129230.542489:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129230.542519:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabca expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.542639:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.542653:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.542664:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.542689:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.542697:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.542718:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543161:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543172:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543181:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129230.543193:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789129230.543337:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543347:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543420:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543426:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129230.543432:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543441:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543456:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129230.543460:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129230.543477:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543485:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce50f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543503:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543510:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543516:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543520:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129230.543524:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543530:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543539:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b4909bd300) 00010000:00010000:3.0:1789129230.543541:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129230.543543:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543550:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce50fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543925:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce50ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabca expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543960:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabca expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.543968:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129230.543971:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129230.543974:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2200, rc 0) 00000100:00100000:3.0:1789129230.544332:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:11827:x1876037604569088:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1875us (2359us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789129230.544344:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:2.0:1789129230.548157:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129230.548465:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604569216 00000100:00100000:1.0:1789129230.548485:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604569216 00000100:00100000:1.0:1789129230.548690:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:1.0:1789129230.548703:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:11827:x1876037604569216:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:1.0:1789129230.548829:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce510f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.548858:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce510f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.548879:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce510f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.548924:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce510f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.548931:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce510f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.548939:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce510f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.548947:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129230.548952:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce510f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.548962:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce510f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.548979:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:1.0:1789129230.548989:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789129230.549014:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce510f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.549022:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce510f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129230.549144:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:11827:x1876037604569216:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 444us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129230.549153:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 206 00000100:00100000:0.0:1789129230.552833:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.554865:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604569472 00000100:00100000:3.0:1789129230.554885:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604569472 00000100:00100000:3.0:1789129230.554969:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:3.0:1789129230.554984:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+54:11827:x1876037604569472:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129230.555301:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:11827:x1876037604569472:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 318us (2482us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789129230.555312:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 58 00000100:00100000:2.0:1789129230.618076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.618197:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604569728 00000100:00100000:3.0:1789129230.618210:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604569728 00000100:00100000:3.0:1789129230.618291:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:3.0:1789129230.618302:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:11837:x1876037604569728:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129230.618334:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129230.618338:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789129230.618515:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5091 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabae expref: 55 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.618562:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129230.618569:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789129230.618587:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce5116 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabd1 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.619133:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.619152:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabca expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.619161:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.619202:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabca expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.619219:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabca expref: 55 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.619235:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383d730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626583808:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129230.619370:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129230.622432:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383d730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6710:1876037626583808:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129230.622477:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129230.624133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129230.624883:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604569856 00000100:00100000:0.0:1789129230.624899:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604569856 00010000:00010000:0.0:1789129230.624958:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabca expref: 56 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129230.625045:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:0.0:1789129230.625059:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490369680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+56:2369:x1876037604569856:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129230.625081:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129230.625089:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabca expref: 56 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.625105:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabca expref: 56 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.625136:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2200/0x5c74554e47ce5101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabca expref: 56 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.625158:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129230.625164:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.625192:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.625201:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.625249:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129230.625358:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490369680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:2369:x1876037604569856:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 294us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129230.625369:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00010000:00010000:1.0:1789129230.625434:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.625443:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129230.625468:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789129230.625717:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2600/0x5c74554e47ce5116 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd1 expref: 56 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.625745:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd1 expref: 55 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.625754:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:1.0:1789129230.625757:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789129230.625760:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2400, rc 0) 00000100:00100000:1.0:1789129230.625804:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:11837:x1876037604569728:12345-192.168.201.39@tcp:101:bash.0 Request processed in 7504us (7745us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789129230.625813:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 207 00000100:00100000:3.0:1789129230.630174:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129230.632152:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604570112 00000100:00100000:1.0:1789129230.632175:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604570112 00000100:00100000:1.0:1789129230.632331:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 208 00000100:00100000:1.0:1789129230.632346:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+55:11837:x1876037604570112:12345-192.168.201.39@tcp:36:bash.0 00010000:00010000:1.0:1789129230.633112:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.633143:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.633158:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789129230.633225:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1789129230.633253:0:5841:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000947d61ed reply state 000000005b20504a transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129230.633264:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789129230.633687:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+58:11837:x1876037604570112:12345-192.168.201.39@tcp:36:bash.0 Request processed in 1338us (3522us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789129230.633700:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 208 00000020:00080000:1.0:1789129230.633710:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789129230.645244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:0.0:1789129230.646003:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.646021:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.646030:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.646038:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129230.646044:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.646054:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.646078:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129230.646082:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129230.646088:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.646122:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce512b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129230.646266:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604570240 00000100:00100000:1.0:1789129230.646280:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604570240 00000100:00100000:1.0:1789129230.646502:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:1.0:1789129230.646516:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:11837:x1876037604570240:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:1.0:1789129230.646549:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129230.646571:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce5132 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabd8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.646705:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.646742:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd1 expref: 58 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.646754:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.646799:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd1 expref: 58 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.646816:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd1 expref: 58 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129230.646834:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e46580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626583936:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129230.646950:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483a24600 going to sleep for 11 seconds 00000100:00100000:1.0:1789129230.649566:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e46580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626583936:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129230.649651:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129230.651743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.652284:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604570368 00000100:00100000:3.0:1789129230.652305:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604570368 00010000:00010000:3.0:1789129230.652367:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd1 expref: 59 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.652415:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:3.0:1789129230.652430:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:2369:x1876037604570368:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129230.652452:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129230.652460:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd1 expref: 59 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.652480:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd1 expref: 59 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.652512:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce511d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd1 expref: 59 pid: 6710 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.652535:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129230.652543:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.652554:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.652565:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.652643:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129230.652844:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+58:2369:x1876037604570368:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 416us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129230.652874:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00010000:00010000:2.0:1789129230.653911:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.653942:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129230.654005:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789129230.654010:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129230.654037:0:5842:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.654081:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce5132 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd8 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.654104:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd8 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.654115:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789129230.654118:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789129230.654122:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b489b86000, rc 0) 00000100:00100000:2.0:1789129230.654183:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490368780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:11837:x1876037604570240:12345-192.168.201.39@tcp:101:bash.0 Request processed in 7669us (8956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129230.654193:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:2.0:1789129230.658466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129230.658583:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604570624 00000100:00100000:1.0:1789129230.658597:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604570624 00000100:00100000:1.0:1789129230.658719:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1789129230.658740:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+57:11837:x1876037604570624:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:1.0:1789129230.659054:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+58:11837:x1876037604570624:12345-192.168.201.39@tcp:35:bash.0 Request processed in 315us (602us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789129230.659063:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 59 00000100:00100000:1.0:1789129230.747574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.747828:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604570752 00000100:00100000:3.0:1789129230.747847:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604570752 00000100:00100000:3.0:1789129230.747936:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:3.0:1789129230.747955:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+58:11843:x1876037604570752:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129230.747998:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129230.748037:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabdf expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.748149:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5147 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.748172:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.748194:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129230.748304:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1789129230.748308:0:6710:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129230.748344:0:6710:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.748379:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabdf expref: 60 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.748408:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabdf expref: 59 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.748435:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129230.748439:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789129230.748445:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3c00, rc 0) 00000100:00100000:3.0:1789129230.748553:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:11843:x1876037604570752:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 603us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129230.748562:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:0.0:1789129230.754582:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129230.756817:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604570880 00000100:00100000:1.0:1789129230.756851:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604570880 00000100:00100000:1.0:1789129230.756979:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:1.0:1789129230.756993:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:11843:x1876037604570880:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129230.757031:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129230.757077:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce514e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabe6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757189:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5155 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757211:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5155 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757228:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5155 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757247:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce515c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757255:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce515c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757262:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce515c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757452:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757462:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757482:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129230.757530:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789129230.757535:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129230.757555:0:5841:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757568:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757579:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5155 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757587:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5155 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.757594:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5155 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758501:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129230.758511:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5155 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758524:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5155 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758544:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789129230.758547:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129230.758553:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758576:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87400/0x5c74554e47ce5155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758594:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce515c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758599:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce515c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758754:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce515c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758759:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129230.758763:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce515c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758770:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce515c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758780:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b49117bd00) 00010000:00010000:1.0:1789129230.758783:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129230.758790:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce515c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758797:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87c00/0x5c74554e47ce515c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758861:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87a00/0x5c74554e47ce514e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabe6 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758878:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabe6 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.758901:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:1.0:1789129230.758904:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789129230.758907:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58da800, rc 0) 00000100:00100000:1.0:1789129230.759272:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:11843:x1876037604570880:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 2279us (4707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129230.759283:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 211 00000100:00100000:2.0:1789129230.772853:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129230.772906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129230.772998:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604571136 00000100:00100000:1.0:1789129230.773012:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604571136 00000100:00100000:1.0:1789129230.773102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:1.0:1789129230.773112:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:11843:x1876037604571136:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129230.773143:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129230.773180:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db600/0x5c74554e47ce516a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabed expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.773337:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.773359:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd8 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.773370:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabe6 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.773379:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.773428:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabe6 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.773468:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabe6 expref: 61 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129230.773486:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e44000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626584064:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129230.773872:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd8 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.773884:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd8 expref: 61 pid: 5842 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129230.773893:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e47840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626584192:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129230.773924:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483a24600 going to sleep for 11 seconds 00000100:00100000:3.0:1789129230.775058:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604571264 00000100:00100000:3.0:1789129230.775079:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604571264 00010000:00010000:3.0:1789129230.775162:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabe6 expref: 62 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.775224:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:3.0:1789129230.775238:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+62:2369:x1876037604571264:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129230.775260:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129230.775268:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabe6 expref: 62 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.775286:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabe6 expref: 62 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.775324:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129230.775333:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.775344:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.775373:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129230.775454:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+62:2369:x1876037604571264:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 217us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129230.775463:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:2.0:1789129230.788492:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:1.0:1789129230.788675:0:5842:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.39@tcp) returned -22 from blocking AST (req@00000000b080088f x1876037626584064) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabe6 expref: 61 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.788706:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabe6 expref: 61 pid: 5841 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129230.788727:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e44000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626584064:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129230.788746:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e47840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5842:1876037626584192:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129230.788779:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:1.0:1789129230.788785:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.788818:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.788828:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.788983:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604571392 00000100:00100000:3.0:1789129230.788994:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604571392 00010000:00010000:3.0:1789129230.789056:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd8 expref: 61 pid: 5842 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129230.789111:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:3.0:1789129230.789125:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+61:2370:x1876037604571392:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129230.789145:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129230.789150:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd8 expref: 61 pid: 5842 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.789162:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd8 expref: 61 pid: 5842 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.789188:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86000/0x5c74554e47ce5139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabd8 expref: 61 pid: 5842 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.789199:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129230.789202:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.789211:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.789227:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.789249:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129230.789317:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:2370:x1876037604571392:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 193us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129230.789325:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00010000:00010000:2.0:1789129230.789949:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.789961:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129230.789995:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789129230.792973:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db600/0x5c74554e47ce516a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabed expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.793018:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabed expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129230.793030:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789129230.793034:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789129230.793039:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58db200, rc 0) 00000100:00100000:2.0:1789129230.793149:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:11843:x1876037604571136:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 20037us (20314us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789129230.793161:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 212 00000100:00100000:2.0:1789129230.810292:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129230.810469:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604571648 00000100:00100000:3.0:1789129230.810484:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604571648 00000100:00100000:3.0:1789129230.810579:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:3.0:1789129230.810594:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:11843:x1876037604571648:12345-192.168.201.39@tcp:103:lfs.0 00010000:00010000:3.0:1789129230.810680:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129230.810719:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362800/0x5c74554e47ce50d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabc3 expref: 60 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129230.810938:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129230.810945:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129230.811023:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:11843:x1876037604571648:12345-192.168.201.39@tcp:103:lfs.0 Request processed in 432us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129230.811032:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:1.0:1789129230.816416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129230.816534:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604571776 00000100:00100000:0.0:1789129230.816548:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604571776 00000100:00100000:0.0:1789129230.816673:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:0.0:1789129230.816687:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:11843:x1876037604571776:12345-192.168.201.39@tcp:58:lfs.0 00010000:00010000:0.0:1789129230.816825:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.816845:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129230.816860:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789129230.817114:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789129230.817231:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:11843:x1876037604571776:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 546us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129230.817240:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 213 00000100:00100000:0.0:1789129230.839791:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129230.840165:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604571904 00000100:00100000:1.0:1789129230.840179:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604571904 00000100:00100000:1.0:1789129230.840254:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:1.0:1789129230.840266:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+59:11843:x1876037604571904:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129230.840296:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129230.840326:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5186 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabf4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.840411:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.840423:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5186 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabf4 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.840449:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.840464:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5186 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabf4 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.840479:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:1.0:1789129230.840499:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789129230.840505:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5186 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabf4 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129230.840513:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58da800, rc 0) 00000100:00100000:1.0:1789129230.840919:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+60:11843:x1876037604571904:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 339us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129230.840931:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 214 00000001:00080000:1.0:1789129231.150991:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967495 is committed 00000004:00080000:1.0:1789129231.151018:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1789129231.151071:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b484fc6b40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789129231.151078:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4b5aa4600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b484fc60c0 00000020:00080000:1.0:1789129231.151082:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4b5aa4800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4b5722c00 00000001:00080000:1.0:1789129231.151113:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000001:00080000:1.0:1789129231.151176:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:1.0:1789129231.151183:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789129231.151204:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4baf1ea80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789129231.151208:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b486557200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b4baf1e540 00000020:00080000:1.0:1789129231.151211:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b4bae47900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4a7af9000 00000100:00100000:1.0:1789129231.151419:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626584320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789129231.151522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789129231.151726:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1789129231.151757:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626584320 00000100:00100000:1.0:1789129231.151767:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626584320 00000100:00100000:1.0:1789129231.151832:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789129231.151842:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626584320:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789129231.151878:0:6689:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1789129231.151936:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3f20d, atime: 0x6aa3f20e, ctime: 0x6aa3f20d, blocks: 0x1 00010000:00010000:1.0:1789129231.151945:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd71c286/0x5c74554e47ce518d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789129231.151963:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1789129231.151964:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=394s v=(0 0) 00010000:00010000:1.0:1789129231.151969:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129231.151978:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd71c286/0x5c74554e47ce518d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.151998:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd71c286/0x5c74554e47ce518d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.152009:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd71c286/0x5c74554e47ce518d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.152018:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd71c286/0x5c74554e47ce518d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.152046:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789129231.152332:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129231.152342:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd71c286/0x5c74554e47ce518d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.152353:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58da200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129231.152365:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd71c286/0x5c74554e47ce518d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.152375:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd71c286/0x5c74554e47ce518d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.152396:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd71c286/0x5c74554e47ce518d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.152404:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd71c286/0x5c74554e47ce518d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.152429:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129231.152431:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129231.152432:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129231.155425:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626584448:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789129231.155538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129231.155672:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626584448 00000100:00100000:2.0:1789129231.155683:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626584448 00000100:00080000:3.0:1789129231.155858:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789129231.156092:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e461c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1876037626584320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4248us (4568us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789129231.156100:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789129231.156111:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626584448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789129231.156151:0:12455:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789129231.156186:0:12455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.156213:0:12455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab84 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.156237:0:12455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789129231.156243:0:12455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789129231.156249:0:12455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129231.156260:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1789129231.156300:0:12455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab84 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.156318:0:12455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab84 expref: 8 pid: 6686 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129231.156332:0:12455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12455:1876037626584576:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129231.156426:0:12455:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d89b40 going to sleep for 11 seconds 00000004:00080000:1.0:1789129231.161264:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b383e44000/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789129231.161434:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626584320:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789129231.165901:0:12455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af0f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12455:1876037626584576:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129231.165966:0:12455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129231.166030:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129231.167038:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604572032 00000100:00100000:2.0:1789129231.167051:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604572032 00010000:00010000:2.0:1789129231.167156:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab84 expref: 9 pid: 6686 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129231.167209:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:2.0:1789129231.167221:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2369:x1876037604572032:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129231.167258:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129231.167266:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4fd4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab84 expref: 9 pid: 6686 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.167282:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab84 expref: 9 pid: 6686 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.167323:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5a4515a/0x5c74554e47ce4fd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.39@tcp remote: 0xd519138c592aab84 expref: 9 pid: 6686 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.167345:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789129231.167350:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789129231.167358:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.167368:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.167408:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129231.167444:0:12455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.167454:0:12455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129231.167482:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e512c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604572032:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 264us (1454us total) trans 0 rc 0/0 00010000:00010000:0.0:1789129231.167486:0:12455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129231.167492:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00010000:00010000:0.0:1789129231.167494:0:12455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.167511:0:12455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789129231.167653:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129231.167671:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.167689:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129231.167694:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.167705:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.167727:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.167735:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcbe8360/0x5c74554e47ce5194 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.167756:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129231.167758:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129231.167759:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129231.169204:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876037626584448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13088us (13659us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789129231.169217:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:2.0:1789129231.169218:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b498ac4000/2, rc 0, transno 4294967319 00000100:00100000:2.0:1789129231.169226:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626584448:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1789129231.169412:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1789129231.495688:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789129231.495700:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789129231.495739:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789129231.495745:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789129231.495900:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e52940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626584704:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789129231.496047:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789129231.511870:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129231.511993:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604572160 00000100:00100000:1.0:1789129231.512006:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604572160 00000100:00100000:1.0:1789129231.512114:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:1.0:1789129231.512147:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11844:x1876037604572160:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789129231.512200:0:5842:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789129231.512369:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11844:x1876037604572160:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 226us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129231.512378:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:2.0:1789129231.513295:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e52940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626584704:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1789129231.518813:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129231.522729:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.522910:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604572288 00000100:00100000:3.0:1789129231.522942:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604572288 00000100:00100000:3.0:1789129231.523036:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 216 00000100:00100000:3.0:1789129231.523049:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11844:x1876037604572288:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789129231.523179:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce519b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.523204:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce519b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.523224:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce519b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527149:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce51a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527178:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce51a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527192:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce51a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527234:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527254:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527265:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129231.527321:0:12509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789129231.527327:0:12509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129231.527343:0:12509:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527731:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce519b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527739:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce519b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527746:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce519b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527773:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129231.527780:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce519b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527790:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce519b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527808:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:3.0:1789129231.527812:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129231.527817:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce519b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527824:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce519b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527843:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce51a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527849:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce51a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527855:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce51a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527861:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129231.527864:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce51a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.527870:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce51a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.528269:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff90b4909bd600) 00010000:00010000:3.0:1789129231.528271:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129231.528275:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce51a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.528281:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce51a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.528300:0:12509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.528306:0:12509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.528311:0:12509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.528316:0:12509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129231.528319:0:12509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.528324:0:12509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.528331:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129231.528333:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129231.528336:0:12509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.528341:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129231.528561:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11844:x1876037604572288:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 5508us (5849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129231.528576:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 216 00000100:00100000:1.0:1789129231.539133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129231.539301:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604572544 00000100:00100000:0.0:1789129231.539312:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604572544 00000100:00100000:0.0:1789129231.539374:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:0.0:1789129231.539383:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11844:x1876037604572544:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789129231.539405:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129231.539430:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce51b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aabfb expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.539571:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce51b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.539594:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce51b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.539659:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce51b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129231.539676:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789129231.539909:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce51b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.539915:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce51b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.539920:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce51b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.539926:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129231.539931:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce51b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.539939:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce51b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.540064:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129231.540067:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789129231.540072:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce51b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.540087:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce51b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.540138:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce51b0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabfb expref: 20 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.540150:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:0.0:1789129231.540152:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129231.540156:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363a00/0x5c74554e47ce51b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabfb expref: 20 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.540163:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363a00, rc 0) 00000100:00100000:0.0:1789129231.540233:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11844:x1876037604572544:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 851us (1123us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1789129231.540238:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 217 00000100:00100000:0.0:1789129231.546919:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.547261:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604572672 00000100:00100000:3.0:1789129231.547277:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604572672 00000100:00100000:3.0:1789129231.547368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 218 00000100:00100000:3.0:1789129231.547381:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11844:x1876037604572672:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789129231.547428:0:5840:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789129231.547686:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11844:x1876037604572672:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 307us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129231.547696:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 218 00010000:00010000:3.0:1789129231.557910:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129231.559054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.559221:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604572928 00000100:00100000:3.0:1789129231.559230:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604572928 00000100:00100000:3.0:1789129231.559301:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:3.0:1789129231.559312:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11844:x1876037604572928:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129231.559332:0:12509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129231.559335:0:12509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789129231.559363:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabdf expref: 19 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.559380:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:3.0:1789129231.559384:0:12509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789129231.559398:0:12509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac02 expref: -99 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789129231.561900:0:12509:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1789129231.563317:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce51cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.563353:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce51cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.563367:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce51cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.563449:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce51c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac02 expref: 21 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.563469:0:12509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce51cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac02 expref: 20 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.563479:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b48544d000) 00010000:00010000:2.0:1789129231.563483:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789129231.563487:0:12509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb000, rc 0) 00000100:00100000:2.0:1789129231.563573:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11844:x1876037604572928:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 4263us (4526us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789129231.563584:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 219 00000100:00100000:2.0:1789129231.570536:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129231.570715:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604573184 00000100:00100000:1.0:1789129231.570738:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604573184 00000100:00100000:1.0:1789129231.571113:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:1.0:1789129231.571126:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bac84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11844:x1876037604573184:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789129231.571201:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129231.571237:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb000/0x5c74554e47ce51cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac02 expref: 20 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.571273:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b48544d000) 00010000:00010000:1.0:1789129231.571285:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129231.571313:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47ce51da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.571328:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47ce51da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.571337:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47ce51da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.571352:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbe00/0x5c74554e47ce51e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1a8ca154 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.571359:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbe00/0x5c74554e47ce51e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a8ca154 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.571390:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbe00/0x5c74554e47ce51e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a8ca154 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.571771:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47ce51da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.571781:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47ce51da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.571787:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47ce51da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572181:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dae00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129231.572186:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47ce51da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572194:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47ce51da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572205:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:1.0:1789129231.572208:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129231.572213:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47ce51da lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572220:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dae00/0x5c74554e47ce51da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572232:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbe00/0x5c74554e47ce51e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a8ca154 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572239:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbe00/0x5c74554e47ce51e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a8ca154 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572255:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbe00/0x5c74554e47ce51e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a8ca154 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572260:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dbe00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129231.572263:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbe00/0x5c74554e47ce51e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a8ca154 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572269:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbe00/0x5c74554e47ce51e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a8ca154 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572276:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1a8ca154 (ffff90b49117bf00) 00010000:00010000:1.0:1789129231.572278:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129231.572281:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbe00/0x5c74554e47ce51e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1a8ca154 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.572286:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbe00/0x5c74554e47ce51e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1a8ca154 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129231.572385:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bac84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11844:x1876037604573184:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1261us (1869us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789129231.572393:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 220 00000100:00100000:0.0:1789129231.575978:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129231.577855:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604573312 00000100:00100000:1.0:1789129231.577870:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604573312 00000100:00100000:1.0:1789129231.578110:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 221 00000100:00100000:1.0:1789129231.578122:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11844:x1876037604573312:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129231.578148:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129231.578175:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58daa00/0x5c74554e47ce51e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac09 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.578245:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.578272:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.578294:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.578407:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58daa00/0x5c74554e47ce51e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac09 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.578427:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac09 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.578435:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b700) 00010000:00010000:1.0:1789129231.578438:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789129231.578442:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58dba00, rc 0) 00000100:00100000:1.0:1789129231.578533:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11844:x1876037604573312:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 413us (2564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129231.578542:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 221 00000100:00100000:0.0:1789129231.589064:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129231.589164:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604573568 00000100:00100000:2.0:1789129231.589175:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604573568 00000100:00100000:2.0:1789129231.589245:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 222 00000100:00100000:2.0:1789129231.589256:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11844:x1876037604573568:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789129231.589355:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.589371:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.589402:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129231.590186:0:12509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1789129231.590199:0:12509:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394687596333ns, next at 395687593389ns, rc = 0 00000004:00010000:2.0:1789129231.590304:0:12509:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000025190a68 reply state 0000000079094cc0 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129231.590317:0:12509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129231.590443:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e52940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:11844:x1876037604573568:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1187us (1492us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789129231.590450:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 222 00010000:00010000:0.0:1789129231.595119:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.595144:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.595153:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.595161:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eba00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129231.595187:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.595196:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.595215:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b700) 00010000:00010000:0.0:1789129231.595219:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789129231.595225:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.595232:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eba00/0x5c74554e47ce51f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129231.599276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129231.599427:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604573696 00000100:00100000:1.0:1789129231.599448:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604573696 00000100:00100000:0.0:1789129231.600162:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:0.0:1789129231.600183:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:11844:x1876037604573696:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789129231.600224:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129231.600253:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce51fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac10 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.600350:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce51fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac10 expref: 22 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.600367:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce51fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac10 expref: 22 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.600390:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b700) 00010000:00010000:0.0:1789129231.600394:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129231.600415:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363400, rc 0) 00000100:00100000:0.0:1789129231.600504:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:11844:x1876037604573696:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 328us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129231.600512:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 223 00000100:00100000:2.0:1789129231.608457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.608647:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604573824 00000100:00100000:3.0:1789129231.608674:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604573824 00000100:00100000:3.0:1789129231.608776:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:3.0:1789129231.608790:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2369:x1876037604573824:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789129231.609283:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2369:x1876037604573824:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 492us (1770us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789129231.609294:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:2.0:1789129231.617906:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129231.624584:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604574080 00000100:00100000:1.0:1789129231.624624:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604574080 00000100:00100000:1.0:1789129231.624741:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:1.0:1789129231.624756:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:11844:x1876037604574080:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789129231.625525:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:11844:x1876037604574080:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 762us (7624us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789129231.626237:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 60 00000100:00100000:2.0:1789129231.626850:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383e503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626584832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129231.627029:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129231.628405:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626584832 00000100:00100000:0.0:1789129231.628419:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626584832 00000100:00100000:0.0:1789129231.628502:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789129231.628514:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626584832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129231.628552:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129231.628686:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876037626584832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129231.628696:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789129231.628771:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383e503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626584832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129231.632678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129231.637700:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604574336 00000100:00100000:2.0:1789129231.637731:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604574336 00000100:00100000:2.0:1789129231.639059:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:2.0:1789129231.639083:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:11844:x1876037604574336:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789129231.642182:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:11844:x1876037604574336:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 177us (6600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129231.653818:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 224 00000100:00100000:2.0:1789129231.660134:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.660431:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604574464 00000100:00100000:3.0:1789129231.660442:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604574464 00000100:00100000:3.0:1789129231.660512:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:3.0:1789129231.660524:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:11844:x1876037604574464:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129231.660547:0:12509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129231.660572:0:12509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5204 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac17 expref: -99 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.660721:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce520b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.660742:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce520b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.660757:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce520b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129231.660928:0:12509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129231.661430:0:12509:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce520b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.661465:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce5204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac17 expref: 25 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.661482:0:12509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce520b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac17 expref: 24 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.661491:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b700) 00010000:00010000:3.0:1789129231.661493:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789129231.661497:0:12509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2c00, rc 0) 00000100:00100000:3.0:1789129231.661568:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11844:x1876037604574464:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 1046us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129231.661576:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 225 00000100:00100000:3.0:1789129231.669145:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129231.669265:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604574592 00000100:00100000:0.0:1789129231.669275:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604574592 00000100:00100000:0.0:1789129231.669338:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:0.0:1789129231.669350:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2369:x1876037604574592:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789129231.669369:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129231.669393:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce5212 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac1e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789129231.669424:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f20f, blocks: 0x1 00010000:00010000:0.0:1789129231.669448:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1789129231.669453:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129231.669464:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce5212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac1e expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.669513:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce5212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac1e expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.669528:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362400, rc 0) 00000100:00100000:0.0:1789129231.669592:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:2369:x1876037604574592:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 244us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129231.669635:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:3.0:1789129231.680076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129231.680236:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604574848 00000100:00100000:1.0:1789129231.680259:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604574848 00000100:00100000:1.0:1789129231.680322:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00100000:1.0:1789129231.680334:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11844:x1876037604574848:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789129231.680465:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11844:x1876037604574848:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 133us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129231.680474:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 226 00000100:00100000:2.0:1789129231.700714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.701342:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604574976 00000100:00100000:3.0:1789129231.701355:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604574976 00000100:00100000:3.0:1789129231.701417:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:3.0:1789129231.701427:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a780d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+10:11844:x1876037604574976:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129231.701448:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129231.701469:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac25 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.701510:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce5212 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac1e expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.701543:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129231.701548:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129231.701555:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.701592:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce5212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac1e expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.701882:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce5212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac1e expref: 11 pid: 6688 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129231.701900:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383d721c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876037626584960:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129231.703030:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789129231.709723:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383d721c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876037626584960:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129231.709771:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 11 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.709809:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3c00, rc 0) 00000100:00100000:3.0:1789129231.709885:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a780d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+11:11844:x1876037604574976:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 8458us (9185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129231.709893:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:0.0:1789129231.713711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129231.713761:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604575104 00000100:00100000:0.0:1789129231.713774:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604575104 00010000:00010000:0.0:1789129231.713839:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce5212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac1e expref: 11 pid: 6688 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129231.713882:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:0.0:1789129231.713894:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+11:2369:x1876037604575104:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129231.713913:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129231.713941:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce5212 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac1e expref: 11 pid: 6688 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.713972:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce5212 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac1e expref: 11 pid: 6688 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.713999:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5d909a1/0x5c74554e47ce5212 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac1e expref: 11 pid: 6688 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.714041:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129231.714047:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129231.714059:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.714071:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.714129:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 10 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129231.714145:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4902fa580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1876037626585088:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789129231.714259:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576d480 going to sleep for 11 seconds 00000100:00100000:2.0:1789129231.744119:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129231.746737:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604575232 00000100:00100000:2.0:1789129231.746767:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604575232 00002000:00100000:2.0:1789129231.747315:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff90b4902fc780 x1876037604575232/t0(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:457/0 lens 504/0 e 0 to 0 dl 1789129242 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789129231.747328:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4902fc780 with x1876037604575232 ext(0->12) 00002000:00010000:2.0:1789129231.747336:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4902fc780 00000100:00100000:2.0:1789129231.747383:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789129231.747398:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+11:2369:x1876037604575232:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789129231.748487:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4902fa580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5825:1876037626585088:192.168.201.39@tcp:105: 00010000:00010000:0.0:1789129231.748527:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129231.748632:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:2369:x1876037604575104:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 34739us (34935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129231.748657:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789129231.751786:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+12:2369:x1876037604575232:12345-192.168.201.39@tcp:4:lhsmtool_posix.0 Request processed in 4375us (7664us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789129231.751816:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00002000:00100000:2.0:1789129231.751833:0:6692:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff90b4902fc780 x1876037604575232/t4294967321(0) o4->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:457/0 lens 504/448 e 0 to 0 dl 1789129242 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789129231.751846:0:6692:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b4902fc780 with x1876037604575232 ext(0->12) 00002000:00010000:2.0:1789129231.751857:0:6692:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b4902fc780 00000100:00100000:3.0:1789129231.772146:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.772198:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604575360 00000100:00100000:3.0:1789129231.772230:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604575360 00000100:00100000:3.0:1789129231.773224:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 227 00000100:00100000:3.0:1789129231.773238:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11844:x1876037604575360:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789129231.818206:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:2.0:1789129231.818907:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:2.0:1789129231.818923:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1789129231.885467:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:1.0:1789129231.885504:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1789129231.885517:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789129231.885550:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789129231.885810:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:3.0:1789129231.885830:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1789129231.885841:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789129231.885872:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383d712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626585216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789129231.886171:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129231.886398:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626585216 00000100:00100000:3.0:1789129231.886410:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626585216 00000100:00100000:3.0:1789129231.886477:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789129231.886489:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626585216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789129231.886908:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11844:x1876037604575360:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 113668us (114772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129231.886920:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 227 00002000:00010000:3.0:1789129231.887160:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789129231.887164:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789129231 00002000:00010000:3.0:1789129231.887166:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789129231.887169:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789129231 -> 1789129231 00002000:00010000:3.0:1789129231.887171:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789129231.887236:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626585216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 750us (1065us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789129231.887243:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789129231.888566:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967319 gen 2 00000004:00080000:1.0:1789129231.888579:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967319 00000004:00080000:1.0:1789129231.888889:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b498ac4000, transno 4294967319 00000100:00100000:1.0:1789129231.888912:0:3309:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff90b383d712c0 x1876037626585216/t4294967322(4294967322) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789129247 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789129231.888927:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b383d712c0/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789129231.888931:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383d712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626585216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789129231.890242:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.890562:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604575488 00000100:00100000:3.0:1789129231.890572:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604575488 00000100:00100000:3.0:1789129231.890681:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:3.0:1789129231.890695:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2367:x1876037604575488:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789129231.946118:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1789129231.946147:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:1.0:1789129231.946389:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2367:x1876037604575488:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 55689us (56143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129231.946402:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:0.0:1789129231.954639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.956093:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604575744 00000100:00100000:3.0:1789129231.956111:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604575744 00000100:00100000:3.0:1789129231.956209:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 228 00000100:00100000:3.0:1789129231.956240:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4902fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11844:x1876037604575744:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789129231.956378:0:12509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129231.956418:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce520b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac17 expref: 20 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.956442:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b700) 00010000:00010000:3.0:1789129231.956449:0:12509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789129231.956486:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.956502:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.956513:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789129231.957215:0:12509:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a69389d3 reply state 00000000acc8eb30 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129231.957230:0:12509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789129231.957505:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4902fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:11844:x1876037604575744:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1264us (2899us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789129231.957515:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 228 00010000:00010000:0.0:1789129231.962309:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.962327:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.962353:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.962359:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129231.962364:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.962372:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.962388:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b700) 00010000:00010000:0.0:1789129231.962391:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129231.962396:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.962402:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce5220 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129231.962661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129231.963211:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604575872 00000100:00100000:0.0:1789129231.963224:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604575872 00000100:00100000:0.0:1789129231.963294:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789129231.963304:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604575872:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789129231.963676:0:12455:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789129231.963680:0:12455:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789129231 -> 1789129230 00002000:00010000:0.0:1789129231.963683:0:12455:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789129230 00002000:00010000:0.0:1789129231.963685:0:12455:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789129231 -> 1789129230 00002000:00010000:0.0:1789129231.963687:0:12455:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789129231.963766:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e45e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2370:x1876037604575872:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 461us (1107us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789129231.963786:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:2.0:1789129231.968094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.968392:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604576128 00000100:00100000:3.0:1789129231.968405:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604576128 00000100:00100000:3.0:1789129231.968480:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 229 00000100:00100000:3.0:1789129231.968492:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4c0b53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:11844:x1876037604576128:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789129231.968574:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.968668:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac09 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.968681:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.968730:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac09 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.968747:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac09 expref: 20 pid: 5841 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129231.968769:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383d71680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626585344:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129231.969095:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b488576e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129231.974170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129231.974281:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604576256 00000100:00100000:2.0:1789129231.974292:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604576256 00010000:00010000:2.0:1789129231.974348:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac09 expref: 21 pid: 5841 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129231.974417:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:2.0:1789129231.974428:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:2370:x1876037604576256:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129231.974446:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129231.974455:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac09 expref: 21 pid: 5841 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.974467:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac09 expref: 21 pid: 5841 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.974490:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b700) 00010000:00010000:2.0:1789129231.974495:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.974503:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.974511:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.974530:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129231.975036:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e46d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:2370:x1876037604576256:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 609us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129231.975044:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00010000:00010000:3.0:1789129231.975295:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce51ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac09 expref: 20 pid: 5841 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129231.975315:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383d71680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626585344:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129231.975344:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.975353:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.975359:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.975394:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.975413:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.975420:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.975426:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129231.975430:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.975438:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.975450:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b700) 00010000:00010000:3.0:1789129231.975453:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789129231.975457:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.975462:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5227 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129231.975515:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4c0b53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11844:x1876037604576128:12345-192.168.201.39@tcp:55:lhsmtool_posix.0 Request processed in 7025us (7440us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789129231.975524:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 229 00000100:00100000:1.0:1789129231.980156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129231.980257:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604576384 00000100:00100000:0.0:1789129231.980267:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604576384 00000100:00100000:0.0:1789129231.980434:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:0.0:1789129231.980445:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5b94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2367:x1876037604576384:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789129231.980497:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.980519:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.980529:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789129231.980533:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789129231.980538:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.980586:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.980775:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 8 pid: 6686 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129231.980810:0:6686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bad28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876037626585472:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129231.980933:0:6686:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129231.984790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129231.984865:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604576512 00000100:00100000:0.0:1789129231.984876:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604576512 00010000:00010000:0.0:1789129231.984924:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 9 pid: 6686 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129231.985190:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:0.0:1789129231.985201:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2370:x1876037604576512:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789129231.985218:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129231.985245:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 9 pid: 6686 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.985260:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 9 pid: 6686 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.985380:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789129231.985385:0:8444:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789129231.985393:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.985405:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129231.985428:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129231.985488:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+9:2370:x1876037604576512:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 289us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129231.985497:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00010000:00010000:2.0:1789129231.985818:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5219 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac25 expref: 8 pid: 6686 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129231.985836:0:6686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bad28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6686:1876037626585472:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129231.985871:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.985882:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.985890:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.985921:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.985930:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.986065:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.986076:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129231.986081:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.986092:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.986106:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129231.986121:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a88a6733/0x5c74554e47ce522e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129231.986173:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5b94b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2367:x1876037604576384:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 5730us (6028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129231.986183:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 70 00000100:00100000:2.0:1789129231.989973:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129231.990113:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604576768 00000100:00100000:3.0:1789129231.990124:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604576768 00000100:00100000:3.0:1789129231.990186:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 230 00000100:00100000:3.0:1789129231.990196:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11844:x1876037604576768:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789129231.990299:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5235 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.990333:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.990344:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.990640:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.990662:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce51fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac10 expref: 20 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.990671:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.990714:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce51fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac10 expref: 20 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.990731:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce51fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac10 expref: 20 pid: 6710 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129231.990748:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383d71680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626585600:192.168.201.39@tcp:104: 00000100:00100000:3.0:1789129231.990856:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b488576e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789129231.995580:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129231.995852:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604576896 00000100:00100000:1.0:1789129231.995868:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604576896 00010000:00010000:1.0:1789129231.995925:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce51fd lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac10 expref: 21 pid: 6710 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129231.995984:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:1.0:1789129231.995995:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:2370:x1876037604576896:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129231.996012:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129231.996020:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce51fd lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac10 expref: 21 pid: 6710 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.996036:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce51fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac10 expref: 21 pid: 6710 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.996062:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b700) 00010000:00010000:1.0:1789129231.996068:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.996078:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.996086:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129231.996108:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129231.996173:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:2370:x1876037604576896:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 180us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129231.996187:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00010000:00010000:3.0:1789129231.997093:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce51fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac10 expref: 20 pid: 6710 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129231.997117:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383d71680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626585600:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129231.997142:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.997161:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129231.997167:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789129231.997395:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1789129231.997552:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789129231.997661:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789129231.997763:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383d71680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876037626585728:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789129231.997843:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129231.997873:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4885769c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129231.998240:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626585728 00000100:00100000:1.0:1789129231.998247:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626585728 00000100:00100000:1.0:1789129231.998399:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789129231.998410:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1876037626585728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789129231.998498:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1876037626585728:12345-0@lo:1000:mdt00_001.0 Request processed in 90us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129231.998505:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789129231.998558:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1789129231.998564:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b383d712c0, transno 4294967322 00000100:00100000:3.0:1789129231.998588:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383d71680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876037626585728:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789129232.000765:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1789129232.000894:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876037626585856:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789129232.001164:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129232.002282:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d89b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789129232.005723:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626585856 00000100:00100000:0.0:1789129232.005748:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626585856 00000100:00100000:2.0:1789129232.006258:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789129232.006343:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876037626585856:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789129232.007215:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1876037626585856:12345-0@lo:1000:mdt00_001.0 Request processed in 943us (6049us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789129232.007226:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789129232.007371:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5841:1876037626585856:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789129232.007427:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007439:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007448:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007454:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129232.007460:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007468:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007490:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b700) 00010000:00010000:0.0:1789129232.007493:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129232.007498:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007505:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce523c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007542:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007549:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007576:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007582:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129232.007585:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007751:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007764:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129232.007767:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129232.007777:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5186 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabf4 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007791:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5186 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabf4 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.007923:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5186 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabf4 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.008120:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5186 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabf4 expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129232.008136:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382101680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626585984:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789129232.008265:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d89cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129232.012464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129232.012837:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604577024 00000100:00100000:1.0:1789129232.012849:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604577024 00000100:00100000:1.0:1789129232.012935:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:1.0:1789129232.012960:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11843:x1876037604577024:12345-192.168.201.39@tcp:49:lfs.0 00000100:00100000:1.0:1789129232.013151:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+24:11843:x1876037604577024:12345-192.168.201.39@tcp:49:lfs.0 Request processed in 195us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129232.013160:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 61 00000100:00100000:3.0:1789129232.015705:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382101680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5841:1876037626585984:192.168.201.39@tcp:105: 00010000:00010000:3.0:1789129232.015746:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.015758:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce517f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016097:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5243 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016113:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5243 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016126:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5243 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016154:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5243 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016161:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5243 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016167:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5243 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016173:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129232.016177:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5243 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016184:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5243 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016197:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129232.016200:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129232.016204:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5243 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016210:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5243 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016221:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016227:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5235 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016233:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5235 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016245:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129232.016248:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5235 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016255:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5235 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016264:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129232.016266:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789129232.016269:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5235 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129232.016350:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2c00/0x5c74554e47ce5235 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129232.017035:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:11844:x1876037604576768:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 26833us (27067us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789129232.017050:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 230 00000020:00080000:3.0:1789129232.017058:0:5841:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789129232.021211:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789129232.021223:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789129232.022106:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789129232.022129:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789129232.024042:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129232.024098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129232.024239:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604577280 00000100:00100000:3.0:1789129232.024251:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604577280 00000100:00100000:3.0:1789129232.024339:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:3.0:1789129232.024352:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:11843:x1876037604577280:12345-192.168.201.39@tcp:58:lfs.0 00000040:00080000:3.0:1789129232.024929:0:12509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789129232.025055:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:11843:x1876037604577280:12345-192.168.201.39@tcp:58:lfs.0 Request processed in 705us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129232.025065:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 231 00000100:00100000:1.0:1789129232.025335:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604577536 00000100:00100000:1.0:1789129232.025342:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604577536 00000100:00100000:1.0:1789129232.025392:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 62 00000100:00100000:1.0:1789129232.025402:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486150050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+23:11844:x1876037604577536:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789129232.026081:0:5843:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789129232.026194:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1789129232.026248:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026266:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026292:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026303:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026309:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026315:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026340:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789129232.026420:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486150050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+25:11844:x1876037604577536:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 1018us (2390us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789129232.026429:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 62 00000020:00080000:1.0:1789129232.026432:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789129232.026489:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129232.026494:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026501:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58da400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129232.026505:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026514:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026528:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff90b49117b300) 00010000:00010000:1.0:1789129232.026530:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789129232.026542:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026548:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da400/0x5c74554e47ce524a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129232.026565:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129232.026567:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129232.026569:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129232.087302:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129232.087560:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604577664 00000100:00100000:3.0:1789129232.087588:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604577664 00000100:00100000:2.0:1789129232.088101:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 232 00000100:00100000:2.0:1789129232.088113:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+25:11846:x1876037604577664:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129232.088138:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129232.088162:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce5251 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088235:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce5258 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088250:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce5258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088263:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce5258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088293:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce525f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088302:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce525f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088309:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce525f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088709:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088723:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabed expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088743:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088787:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabed expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.088818:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabed expref: 26 pid: 5842 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129232.088832:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382103480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626586112:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129232.088926:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b491d89a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129232.093684:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129232.093788:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604577920 00000100:00100000:1.0:1789129232.093810:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604577920 00000100:00100000:1.0:1789129232.093878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:1.0:1789129232.093889:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:5609:x1876037604577920:12345-192.168.201.39@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789129232.094195:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:5609:x1876037604577920:12345-192.168.201.39@tcp:35:ldlm_bl.0 Request processed in 307us (523us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789129232.094204:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 63 00000100:00100000:2.0:1789129232.095544:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382103480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5840:1876037626586112:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129232.095578:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129232.097873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129232.098193:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604578048 00000100:00100000:2.0:1789129232.098202:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604578048 00010000:00010000:2.0:1789129232.098260:0:8444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabed expref: 28 pid: 5842 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129232.098343:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:2.0:1789129232.098354:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:2370:x1876037604578048:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129232.098372:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129232.098379:0:8444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabed expref: 28 pid: 5842 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.098420:0:8444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabed expref: 28 pid: 5842 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.098452:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5171 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aabed expref: 28 pid: 5842 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.098473:0:8444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789129232.098481:0:8444:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.098493:0:8444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.098504:0:8444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129232.098542:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129232.098660:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:2370:x1876037604578048:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 307us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129232.098669:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00010000:00010000:0.0:1789129232.099832:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.099866:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129232.099922:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789129232.099928:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789129232.099965:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.099983:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.099993:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce5258 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100001:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce5258 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100008:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce5258 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100014:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebc00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129232.100019:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce5258 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100027:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce5258 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100043:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129232.100046:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129232.100050:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce5258 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100067:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebc00/0x5c74554e47ce5258 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100083:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce525f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100090:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce525f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100095:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce525f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100100:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129232.100103:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce525f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100108:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce525f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100115:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90b48544d100) 00010000:00010000:0.0:1789129232.100117:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129232.100121:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce525f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100127:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb200/0x5c74554e47ce525f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100168:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb400/0x5c74554e47ce5251 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac2c expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100182:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac2c expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129232.100196:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129232.100198:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129232.100201:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea200, rc 0) 00000100:00100000:0.0:1789129232.100277:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:11846:x1876037604577664:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 12157us (12994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129232.100285:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 232 00010000:00010000:2.0:1789129232.588908:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789129232.761983:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1789129232.763120:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1789129232.765802:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:0.0:1789129233.030706:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789129233.030719:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789129233.030762:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789129233.030770:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789129233.030909:0:12072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626586240:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789129233.031033:0:12072:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b576dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129233.037190:0:12072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12072:1876037626586240:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789129233.051763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129233.052311:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604578176 00000100:00100000:3.0:1789129233.052325:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604578176 00000100:00100000:3.0:1789129233.052406:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:3.0:1789129233.052418:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:11857:x1876037604578176:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789129233.052458:0:5841:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789129233.052572:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:11857:x1876037604578176:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 156us (822us total) trans 0 rc 0/0 00000100:00080000:0.0:1789129233.052766:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129233.053069:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 233 00000100:00100000:3.0:1789129233.062920:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129233.063009:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604578432 00000100:00100000:2.0:1789129233.063021:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604578432 00000100:00100000:2.0:1789129233.063104:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 234 00000100:00100000:2.0:1789129233.063116:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+26:11857:x1876037604578432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789129233.063153:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129233.063175:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce526d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac33 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129233.063291:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce5274 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129233.063308:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce5274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129233.063322:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce5274 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129233.063335:0:6710:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789129233.063508:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eac00/0x5c74554e47ce526d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac33 expref: 29 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129233.063529:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce5274 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac33 expref: 28 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129233.063537:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:2.0:1789129233.063540:0:6710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789129233.063544:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb600, rc 0) 00000100:00100000:2.0:1789129233.063640:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:11857:x1876037604578432:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 526us (730us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789129233.063648:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 234 00000100:00100000:3.0:1789129233.076338:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129233.076478:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604578560 00000100:00100000:1.0:1789129233.076489:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604578560 00000100:00100000:1.0:1789129233.076572:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789129233.076583:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:2369:x1876037604578560:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129233.076616:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129233.076651:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb600/0x5c74554e47ce5274 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac33 expref: 28 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129233.076669:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:1.0:1789129233.076674:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129233.076748:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:2369:x1876037604578560:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 167us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129233.076764:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789129233.085952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129233.086038:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604578816 00000100:00100000:3.0:1789129233.086050:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604578816 00000100:00100000:3.0:1789129233.086115:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 235 00000100:00100000:3.0:1789129233.086126:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+27:11857:x1876037604578816:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789129233.086216:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5282 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129233.086234:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129233.086248:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129233.086453:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5282 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129233.086461:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5282 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129233.086479:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5282 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129233.086484:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129233.086488:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5282 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129233.086505:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5282 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129233.086519:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:3.0:1789129233.086522:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789129233.086526:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5282 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129233.086533:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3a00/0x5c74554e47ce5282 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129233.086725:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:11857:x1876037604578816:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 600us (784us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789129233.086735:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 235 00000040:00080000:3.0:1789129233.086853:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129233.086858:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129233.087367:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789129233.087378:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789129233.092026:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129233.092068:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604579072 00000100:00100000:3.0:1789129233.092078:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604579072 00000100:00100000:3.0:1789129233.092136:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:3.0:1789129233.092157:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+28:11857:x1876037604579072:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789129233.092427:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+29:11857:x1876037604579072:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 272us (410us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789129233.092435:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 64 00000100:00100000:0.0:1789129233.157856:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626586496:0@lo:400:kworker.0 00000100:00100000:0.0:1789129233.157930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129233.157987:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382820780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626587008:0@lo:400:kworker.0 00000100:00100000:0.0:1789129233.158015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129233.158046:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129233.158052:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382821e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626586624:0@lo:400:kworker.0 00000100:00100000:0.0:1789129233.158074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129233.158113:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626587008 00000100:00100000:0.0:1789129233.158120:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626587008 00000100:00100000:0.0:1789129233.158173:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789129233.158183:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626587008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129233.158249:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626587008:12345-0@lo:400:kworker.0 Request processed in 68us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129233.158257:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789129233.158281:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626586496 00000100:00100000:0.0:1789129233.158285:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626586496 00000100:00100000:0.0:1789129233.158306:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626586624 00000100:00100000:0.0:1789129233.158309:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626586624 00000100:00100000:0.0:1789129233.158331:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789129233.158337:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382822940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626586496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129233.158371:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382822940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626586496:12345-0@lo:400:kworker.0 Request processed in 34us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129233.158377:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789129233.158390:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789129233.158396:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626586624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129233.158420:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626586624:12345-0@lo:400:kworker.0 Request processed in 24us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129233.158425:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1789129233.158455:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789129233.158460:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129233.158490:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382821e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626586624:0@lo:400:kworker.0 00000100:00100000:0.0:1789129233.158502:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626586496:0@lo:400:kworker.0 00000100:00100000:0.0:1789129233.158524:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382820780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626587008:0@lo:400:kworker.0 00000100:00100000:1.0:1789129233.158655:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b575f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626586368:0@lo:400:kworker.0 00000100:00100000:1.0:1789129233.158690:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129233.158717:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382820b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626586880:0@lo:400:kworker.0 00000100:00100000:1.0:1789129233.158739:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129233.158758:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789129233.158763:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382823840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626586752:0@lo:400:kworker.0 00000100:00100000:1.0:1789129233.158784:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129233.158807:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626586880 00000100:00100000:1.0:1789129233.158810:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626586880 00000100:00100000:1.0:1789129233.158837:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789129233.158843:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626586880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129233.158877:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626586880:12345-0@lo:400:kworker.0 Request processed in 33us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129233.158883:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789129233.158900:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626586752 00000100:00100000:1.0:1789129233.158904:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626586752 00000100:00100000:1.0:1789129233.158933:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789129233.158940:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626586752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129233.158970:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626586752:12345-0@lo:400:kworker.0 Request processed in 31us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129233.158977:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789129233.158999:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789129233.159005:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1789129233.159039:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b383e44000, transno 4294967310 00000100:00100000:1.0:1789129233.159075:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382823840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626586752:0@lo:400:kworker.0 00000100:00100000:1.0:1789129233.159088:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382820b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626586880:0@lo:400:kworker.0 00000100:00100000:0.0:1789129233.159342:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626586368 00000100:00100000:0.0:1789129233.159347:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626586368 00000100:00100000:0.0:1789129233.159379:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789129233.159386:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626586368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129233.159430:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626586368:12345-0@lo:400:kworker.0 Request processed in 44us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129233.159550:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:0.0:1789129233.159577:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789129233.159581:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129233.159599:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b575f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626586368:0@lo:400:kworker.0 00000100:00100000:1.0:1789129233.159913:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626587136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129233.159945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129233.160031:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626587136 00000100:00100000:0.0:1789129233.160036:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626587136 00000100:00100000:0.0:1789129233.160072:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789129233.160079:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626587136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789129233.160103:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129233.160148:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876037626587136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129233.160155:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789129233.160235:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626587136:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789129233.219472:0:13009:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789129233.219484:0:13009:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789129233.219535:0:13009:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789129233.219541:0:13009:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789129233.563298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129233.563391:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604579328 00000100:00100000:1.0:1789129233.563402:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604579328 00000100:00100000:1.0:1789129233.563473:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:1.0:1789129233.563484:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+29:11870:x1876037604579328:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:1.0:1789129233.563525:0:12509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129233.563562:0:12509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5289 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac3a expref: -99 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129233.563745:0:12509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da000/0x5c74554e47ce5290 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129233.563766:0:12509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da000/0x5c74554e47ce5290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129233.563781:0:12509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da000/0x5c74554e47ce5290 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129233.563794:0:12509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789129233.563944:0:12509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58db200/0x5c74554e47ce5289 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac3a expref: 32 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129233.563962:0:12509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da000/0x5c74554e47ce5290 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac3a expref: 31 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129233.563984:0:12509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:1.0:1789129233.563987:0:12509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789129233.563991:0:12509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58da000, rc 0) 00000100:00100000:1.0:1789129233.564050:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:11870:x1876037604579328:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 568us (765us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789129233.564057:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 236 00000100:00100000:3.0:1789129233.568656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129233.568761:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604579456 00000100:00100000:0.0:1789129233.568773:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604579456 00000100:00100000:0.0:1789129233.568835:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 237 00000100:00100000:0.0:1789129233.568846:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:11870:x1876037604579456:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:0.0:1789129233.568927:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce529e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.568945:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce529e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.568970:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce529e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.569002:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce529e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.569009:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce529e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.569017:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce529e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.569022:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129233.569026:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce529e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.569034:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce529e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.569047:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129233.569050:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129233.569055:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce529e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.569061:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce529e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129233.569141:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:11870:x1876037604579456:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 297us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129233.569149:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 237 00010000:00010000:3.0:1789129233.613708:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129233.842404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129233.842693:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604579584 00000100:00100000:0.0:1789129233.842726:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604579584 00000100:00100000:0.0:1789129233.842826:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:0.0:1789129233.842838:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604579584:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:0.0:1789129233.842862:0:12455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1789129233.843163:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789129233.843249:0:12455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce52a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac41 expref: -99 pid: 12455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789129233.843285:0:12455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3f20e, atime: 0x6aa3f20e, ctime: 0x6aa3f20e, blocks: 0xb 00010000:00010000:0.0:1789129233.843313:0:12455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1789129233.843320:0:12455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129233.843334:0:12455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce52a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac41 expref: 8 pid: 12455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.843357:0:12455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce52a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac41 expref: 8 pid: 12455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129233.843376:0:12455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:0.0:1789129233.843468:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2370:x1876037604579584:12345-192.168.201.39@tcp:101:cat.0 Request processed in 631us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129233.843549:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 71 00000100:00100000:1.0:1789129233.861159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129233.861460:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604579712 00000100:00100000:3.0:1789129233.861598:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604579712 00002000:00100000:3.0:1789129233.861736:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff90b383e44000 x1876037604579712/t0(0) o3->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:459/0 lens 488/0 e 0 to 0 dl 1789129244 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789129233.861751:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383e44000 with x1876037604579712 ext(0->4095) 00002000:00010000:3.0:1789129233.861761:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383e44000 00000100:00100000:3.0:1789129233.861801:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789129233.861813:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2368:x1876037604579712:12345-192.168.201.39@tcp:3:cat.0 00000100:00100000:2.0:1789129233.863730:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383e44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2368:x1876037604579712:12345-192.168.201.39@tcp:3:cat.0 Request processed in 1901us (2570us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789129233.863770:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00002000:00100000:2.0:1789129233.863782:0:6693:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff90b383e44000 x1876037604579712/t0(0) o3->9463e625-4f12-4089-85aa-d90aafb8e5a9@192.168.201.39@tcp:459/0 lens 488/4536 e 0 to 0 dl 1789129244 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789129233.863793:0:6693:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90b383e44000 with x1876037604579712 ext(0->4095) 00002000:00010000:2.0:1789129233.863802:0:6693:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90b383e44000 00010000:00010000:1.0:1789129234.629952:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129235.489837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129235.489886:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129235.489923:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129235.489948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129235.489968:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129235.489997:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604579840 00000100:00100000:3.0:1789129235.490005:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604579840 00000100:00100000:3.0:1789129235.490057:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 341 00000100:00100000:3.0:1789129235.490067:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604579840:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129235.490231:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604579840:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129235.490240:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 341 00000100:00100000:3.0:1789129235.490284:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604580224 00000100:00100000:3.0:1789129235.490288:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604580224 00000100:00100000:3.0:1789129235.490319:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604580096 00000100:00100000:3.0:1789129235.490321:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604580096 00000100:00100000:3.0:1789129235.490342:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:3.0:1789129235.490348:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2367:x1876037604580224:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129235.490429:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+8:2367:x1876037604580224:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 80us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129235.490436:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:3.0:1789129235.490447:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:3.0:1789129235.490452:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604580096:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129235.490472:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604580096:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 20us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129235.490477:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:3.0:1789129235.490493:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604579968 00000100:00100000:3.0:1789129235.490496:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604579968 00000100:00100000:3.0:1789129235.490520:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604580352 00000100:00100000:3.0:1789129235.490523:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604580352 00000100:00100000:3.0:1789129235.490539:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:3.0:1789129235.490545:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383d712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:2367:x1876037604579968:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129235.490570:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383d712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+31:2367:x1876037604579968:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129235.490599:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 199 00000100:00100000:3.0:1789129235.490634:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00100000:3.0:1789129235.490641:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5af7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604580352:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129235.490667:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5af7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2367:x1876037604580352:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129235.490673:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 200 00000100:00080000:3.0:1789129235.490779:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789129235.490784:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789129235.490786:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789129235.675903:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129236.677869:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129236.742229:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626587264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129236.742302:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129236.742500:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626587264 00000100:00100000:0.0:1789129236.742508:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626587264 00000100:00100000:0.0:1789129236.742576:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789129236.742585:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626587264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129236.742633:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129236.742675:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490369680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626587264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129236.742697:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789129236.742778:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129236.742811:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626587264:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789129237.322975:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1789129237.323007:0:5862:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90b4885769c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789129237.323012:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b497f0e900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90b488576cc0 00000020:00080000:2.0:1789129237.323015:0:5862:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90b497f0ec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90b4b5720c00 00000020:00080000:0.0:1789129237.327625:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789129237.327915:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1789129237.343218:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1789129237.343238:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1789129237.704048:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129238.278627:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626587648:0@lo:400:kworker.0 00000100:00100000:1.0:1789129238.278688:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626587392:0@lo:400:kworker.0 00000100:00100000:3.0:1789129238.278716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129238.278843:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626587520:0@lo:400:kworker.0 00000100:00100000:0.0:1789129238.278978:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626587776:0@lo:400:kworker.0 00000100:00100000:1.0:1789129238.283310:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129238.283409:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a79fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626587904:0@lo:400:kworker.0 00000100:00100000:1.0:1789129238.283474:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129238.283565:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626587392 00000100:00100000:1.0:1789129238.283573:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626587392 00000100:00100000:3.0:1789129238.283628:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626587648 00000100:00100000:3.0:1789129238.283634:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626587648 00000100:00100000:1.0:1789129238.283637:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789129238.283649:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626587392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129238.283685:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626587904 00000100:00100000:3.0:1789129238.283689:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626587904 00000100:00100000:1.0:1789129238.283712:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626587392:12345-0@lo:400:kworker.0 Request processed in 64us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129238.283719:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789129238.283724:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789129238.283731:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a789ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626587648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129238.283771:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626587392:0@lo:400:kworker.0 00000100:00100000:3.0:1789129238.283797:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a789ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626587648:12345-0@lo:400:kworker.0 Request processed in 68us (5081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129238.283825:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789129238.283844:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789129238.283852:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626587904:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789129238.283857:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129238.283892:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626587904:12345-0@lo:400:kworker.0 Request processed in 41us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129238.283898:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789129238.283925:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626587904:0@lo:400:kworker.0 00000100:00100000:3.0:1789129238.283945:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626588160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129238.283973:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129238.284001:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626587648:0@lo:400:kworker.0 00000100:00100000:3.0:1789129238.284029:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626588160 00000100:00100000:3.0:1789129238.284033:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626588160 00000100:00100000:3.0:1789129238.284067:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789129238.284074:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7898f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626588160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789129238.284101:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129238.284137:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7898f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626588160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129238.284143:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1789129238.284156:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129238.284169:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789129238.284175:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789129238.284196:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626588160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129238.284780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129238.284804:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7899e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626588032:0@lo:400:kworker.0 00000100:00100000:2.0:1789129238.284826:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129238.284866:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626587520 00000100:00100000:2.0:1789129238.284870:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626587520 00000100:00100000:2.0:1789129238.284895:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789129238.284901:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382100780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626587520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129238.284932:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382100780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626587520:12345-0@lo:400:kworker.0 Request processed in 32us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129238.284938:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789129238.284962:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626587520:0@lo:400:kworker.0 00000100:00100000:0.0:1789129238.285149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129238.287852:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626588032 00000100:00100000:2.0:1789129238.287867:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626588032 00000100:00100000:2.0:1789129238.287929:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626587776 00000100:00100000:2.0:1789129238.287948:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626587776 00000100:00100000:2.0:1789129238.287988:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789129238.287997:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626588032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129238.288085:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382103480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626588032:12345-0@lo:400:kworker.0 Request processed in 89us (3257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129238.288093:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789129238.288107:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789129238.288114:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626587776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129238.288152:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626587776:12345-0@lo:400:kworker.0 Request processed in 39us (3004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129238.288159:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789129238.288218:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a79fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626587776:0@lo:400:kworker.0 00000100:00100000:1.0:1789129238.290136:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7899e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626588032:0@lo:400:kworker.0 00000100:00080000:1.0:1789129238.290188:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789129238.726824:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789129239.239065:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789129239.239081:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129239.239394:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1789129239.239400:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789129239.749954:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129240.246965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129240.247444:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604580480 00000100:00100000:1.0:1789129240.249180:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604580480 00000100:00100000:1.0:1789129240.249414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00100000:1.0:1789129240.249430:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382101680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11523:x1876037604580480:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789129240.249576:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382101680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11523:x1876037604580480:12345-192.168.201.39@tcp:60:lhsmtool_posix.0 Request processed in 152us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129240.249586:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 238 00000100:00080000:3.0:1789129240.250139:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129240.251804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129240.251913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604580736 00000100:00100000:0.0:1789129240.251923:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604580736 00000100:00100000:0.0:1789129240.251981:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:0.0:1789129240.251990:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:11523:x1876037604580736:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789129240.252575:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:11523:x1876037604580736:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 584us (779us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789129240.252585:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 65 00000100:00100000:2.0:1789129240.486308:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129240.486429:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604580864 00000100:00100000:1.0:1789129240.486441:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604580864 00000100:00100000:1.0:1789129240.486541:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00100000:1.0:1789129240.486552:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b490233840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:12321:x1876037604580864:12345-192.168.201.39@tcp:101:lsof.0 00010000:00010000:1.0:1789129240.486594:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129240.486691:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbc00/0x5c74554e47ce52ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aac48 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129240.486764:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce52b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129240.486780:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce52b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129240.486795:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce52b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129240.487009:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789129240.487014:0:5840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129240.487089:0:5840:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce52b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129240.487118:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dbc00/0x5c74554e47ce52ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac48 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129240.487142:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce52b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac48 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129240.487151:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48544d600) 00010000:00010000:1.0:1789129240.487155:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789129240.487159:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58dba00, rc 0) 00000100:00100000:1.0:1789129240.487232:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b490233840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:12321:x1876037604580864:12345-192.168.201.39@tcp:101:lsof.0 Request processed in 682us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129240.487240:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 239 00000100:00080000:2.0:1789129240.487772:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789129240.603939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129240.603989:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129240.604083:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604581120 00000100:00100000:1.0:1789129240.604092:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604581120 00000100:00100000:1.0:1789129240.604154:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:1.0:1789129240.604163:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a78983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:2370:x1876037604581120:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129240.604243:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a78983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:2370:x1876037604581120:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 81us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129240.604251:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 204 00000100:00100000:3.0:1789129240.605557:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129240.605586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129240.605704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604580992 00000100:00100000:1.0:1789129240.605711:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604580992 00000100:00100000:1.0:1789129240.605746:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 343 00000100:00100000:1.0:1789129240.605754:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604580992:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129240.605804:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39f4e36-8626-43c5-a083-60799197f867+13:2370:x1876037604580992:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 51us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129240.605811:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 343 00000100:00100000:3.0:1789129240.607985:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129240.608928:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604581504 00000100:00100000:1.0:1789129240.608957:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604581504 00000100:00100000:1.0:1789129240.609023:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:1.0:1789129240.609033:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a789b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2370:x1876037604581504:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129240.609114:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a789b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2370:x1876037604581504:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 82us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129240.609121:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 205 00000100:00100000:2.0:1789129240.610905:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604581376 00000100:00100000:2.0:1789129240.610917:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604581376 00000100:00100000:2.0:1789129240.611056:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604581248 00000100:00100000:2.0:1789129240.611059:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604581248 00000100:00100000:3.0:1789129240.611116:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:3.0:1789129240.611129:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a789bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604581376:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129240.611210:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a789bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604581376:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 83us (7220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129240.611217:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00080000:1.0:1789129240.612085:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789129240.612091:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789129240.612209:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:2.0:1789129240.612219:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7898b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2370:x1876037604581248:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129240.612487:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7898b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2370:x1876037604581248:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 268us (6897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129240.612504:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00010000:00010000:1.0:1789129240.775383:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129241.800031:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129241.862309:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789129241.862342:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a77c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626588288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129241.862412:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129241.862870:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626588288 00000100:00100000:0.0:1789129241.862879:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626588288 00000100:00100000:0.0:1789129241.862955:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789129241.862965:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626588288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129241.863018:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129241.863072:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626588288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129241.863081:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1789129241.863365:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129241.863512:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a77c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626588288:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789129242.519580:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1789129242.519624:0:5862:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789129242.520308:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789129242.520325:0:5873:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1789129242.822557:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129243.404678:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a789b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626588416:0@lo:400:kworker.0 00000100:00100000:3.0:1789129243.404705:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a789a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626588672:0@lo:400:kworker.0 00000100:00100000:1.0:1789129243.404810:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a789a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626588544:0@lo:400:kworker.0 00000100:00100000:2.0:1789129243.404872:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626588800:0@lo:400:kworker.0 00000100:00100000:0.0:1789129243.425487:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129243.425635:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a789a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626588928:0@lo:400:kworker.0 00000100:00100000:0.0:1789129243.425692:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129243.425749:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626588928 00000100:00100000:0.0:1789129243.425759:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626588928 00000100:00100000:0.0:1789129243.425838:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789129243.425849:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a77c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626588928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129243.426150:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a77c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876037626588928:12345-0@lo:400:kworker.0 Request processed in 302us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129243.426160:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:0.0:1789129243.426188:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129243.427087:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a789a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876037626588928:0@lo:400:kworker.0 00000100:00100000:0.0:1789129243.427177:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626588416 00000100:00100000:0.0:1789129243.427183:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626588416 00000100:00100000:0.0:1789129243.427645:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789129243.427659:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626588416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129243.427754:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3309:x1876037626588416:12345-0@lo:400:kworker.0 Request processed in 98us (2278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129243.427762:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789129243.427819:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a789b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626588416:0@lo:400:kworker.0 00000100:00100000:1.0:1789129243.438230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129243.438311:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626588544 00000100:00100000:1.0:1789129243.438324:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626588544 00000100:00100000:1.0:1789129243.438403:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789129243.438415:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626588544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129243.438491:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626588544:12345-0@lo:400:kworker.0 Request processed in 78us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129243.438499:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789129243.438583:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a789a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626588544:0@lo:400:kworker.0 00000100:00100000:1.0:1789129243.438598:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a789b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626589056:0@lo:400:kworker.0 00000100:00100000:1.0:1789129243.438652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129243.438819:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789129243.438829:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b485c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626589184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129243.438878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129243.438904:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626589184 00000100:00100000:1.0:1789129243.438909:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626589184 00000100:00100000:1.0:1789129243.438958:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789129243.438966:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626589184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129243.439005:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129243.439041:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626589184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129243.439048:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1789129243.439067:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789129243.439096:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b485c52940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626589184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129243.439151:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626589056 00000100:00100000:1.0:1789129243.439154:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626589056 00000100:00100000:1.0:1789129243.439182:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789129243.439190:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626589056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129243.439226:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626589056:12345-0@lo:400:kworker.0 Request processed in 38us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129243.439233:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789129243.439260:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a789b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626589056:0@lo:400:kworker.0 00000100:00100000:2.0:1789129243.451366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129243.452840:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626588800 00000100:00100000:0.0:1789129243.452856:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626588800 00000100:00100000:0.0:1789129243.452982:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789129243.452995:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626588800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129243.453110:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626588800:12345-0@lo:400:kworker.0 Request processed in 118us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129243.453132:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789129243.453489:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789129243.454642:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129243.454714:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626588800:0@lo:400:kworker.0 00000100:00100000:0.0:1789129243.455317:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626588672 00000100:00100000:0.0:1789129243.455327:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626588672 00000100:00100000:0.0:1789129243.455403:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789129243.455414:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626588672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129243.455543:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626588672:12345-0@lo:400:kworker.0 Request processed in 130us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129243.455552:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789129243.456071:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a789a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626588672:0@lo:400:kworker.0 00000100:00080000:2.0:1789129243.457400:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789129243.847254:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129244.873192:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789129245.366262:0:13212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:20:42 (1789129242) 00000100:00100000:3.0:1789129245.726825:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129245.726929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129245.726976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129245.727006:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129245.727056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129245.727136:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604582144 00000100:00100000:0.0:1789129245.727157:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604582144 00000100:00100000:0.0:1789129245.727232:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604581760 00000100:00100000:0.0:1789129245.727235:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604581760 00000100:00100000:0.0:1789129245.727262:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:0.0:1789129245.727271:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a78992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2367:x1876037604582144:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129245.727345:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a78992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2367:x1876037604582144:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 75us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129245.727364:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 209 00000100:00100000:0.0:1789129245.727391:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:0.0:1789129245.727406:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a789b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:2367:x1876037604581760:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129245.727433:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a789b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:2367:x1876037604581760:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129245.727439:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 210 00000100:00100000:0.0:1789129245.727484:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604581888 00000100:00100000:0.0:1789129245.727489:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604581888 00000100:00100000:0.0:1789129245.727525:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604582016 00000100:00100000:0.0:1789129245.727528:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604582016 00000100:00100000:0.0:1789129245.727550:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:0.0:1789129245.727557:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a789a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604581888:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129245.727585:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a789a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2367:x1876037604581888:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 29us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129245.727592:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:0.0:1789129245.727633:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00100000:0.0:1789129245.727640:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a789a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2367:x1876037604582016:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129245.727664:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a789a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2367:x1876037604582016:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129245.727670:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 107 00000100:00080000:3.0:1789129245.728540:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789129245.728547:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789129245.728550:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129245.728829:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604581632 00000100:00100000:1.0:1789129245.728837:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604581632 00000100:00100000:1.0:1789129245.728881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 345 00000100:00100000:1.0:1789129245.728889:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604581632:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129245.728949:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604581632:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 60us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129245.729167:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 345 00010000:00010000:2.0:1789129245.898280:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129246.918994:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129246.996771:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626589312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789129246.996897:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129246.997010:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626589312 00000100:00100000:0.0:1789129246.997019:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626589312 00000100:00100000:0.0:1789129246.997101:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789129246.997113:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626589312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129246.997174:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129246.997230:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626589312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129247.000566:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1789129247.000845:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129247.004915:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626589312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789129247.942209:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129248.518467:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626589568:0@lo:400:kworker.0 00000100:00100000:3.0:1789129248.518567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129248.518667:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7889a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626590080:0@lo:400:kworker.0 00000100:00100000:3.0:1789129248.518695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129248.518726:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129248.518733:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626589696:0@lo:400:kworker.0 00000100:00100000:3.0:1789129248.518830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129248.519127:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626589824:0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129248.519188:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789129248.519194:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626589440:0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519240:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129248.519261:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626589952:0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519284:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129248.519313:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626590080 00000100:00100000:1.0:1789129248.519320:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626590080 00000100:00100000:1.0:1789129248.519398:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626589824 00000100:00100000:1.0:1789129248.519402:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626589824 00000100:00100000:1.0:1789129248.519430:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789129248.519440:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7899e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626590080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519500:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7899e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626590080:12345-0@lo:400:kworker.0 Request processed in 61us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129248.519508:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789129248.519526:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789129248.519533:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626589824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519568:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626589824:12345-0@lo:400:kworker.0 Request processed in 35us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129248.519574:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789129248.519595:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626589568 00000100:00100000:1.0:1789129248.519597:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626589568 00000100:00100000:1.0:1789129248.519657:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626589696 00000100:00100000:1.0:1789129248.519661:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626589696 00000100:00100000:1.0:1789129248.519676:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626589952 00000100:00100000:1.0:1789129248.519679:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626589952 00000100:00100000:1.0:1789129248.519693:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789129248.519700:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626589568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519734:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626589568:12345-0@lo:400:kworker.0 Request processed in 35us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129248.519741:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789129248.519753:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789129248.519759:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a789b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626589696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519789:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a789b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626589696:12345-0@lo:400:kworker.0 Request processed in 30us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129248.519794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789129248.519805:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789129248.519811:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626589952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519836:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626589952:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129248.519841:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:1.0:1789129248.519858:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789129248.519863:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789129248.519866:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789129248.519904:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626589952:0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519916:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626589824:0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519952:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626589696:0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519963:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626589568:0@lo:400:kworker.0 00000100:00100000:1.0:1789129248.519984:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7889a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626590080:0@lo:400:kworker.0 00000100:00100000:0.0:1789129248.520657:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626589440 00000100:00100000:0.0:1789129248.520674:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626589440 00000100:00100000:0.0:1789129248.520714:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789129248.520721:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626589440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129248.520786:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3308:x1876037626589440:12345-0@lo:400:kworker.0 Request processed in 64us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129248.520792:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789129248.520846:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626589440:0@lo:400:kworker.0 00000100:00100000:0.0:1789129248.523392:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a789a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626590208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129248.523483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129248.527651:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626590208 00000100:00100000:3.0:1789129248.527681:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626590208 00000100:00100000:3.0:1789129248.527775:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789129248.527788:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626590208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789129248.527845:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129248.527986:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626590208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (4501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129248.527996:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789129248.528652:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a789a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626590208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789129248.965993:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789129249.477983:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789129249.477996:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789129249.478668:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789129249.478677:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789129249.989955:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129250.849978:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129250.850047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129250.850177:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604582400 00000100:00100000:1.0:1789129250.850199:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604582400 00000100:00100000:0.0:1789129250.850238:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604582272 00000100:00100000:0.0:1789129250.850250:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604582272 00000100:00100000:0.0:1789129250.850358:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 347 00000100:00100000:1.0:1789129250.850359:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:0.0:1789129250.850379:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2368:x1876037604582272:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129250.850390:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a789a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:2368:x1876037604582400:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129250.850504:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39f4e36-8626-43c5-a083-60799197f867+13:2368:x1876037604582272:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 129us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129250.850513:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 347 00000100:00080000:3.0:1789129250.850743:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129250.862652:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a789a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:2368:x1876037604582400:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 12228us (12555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129250.862675:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 214 00000100:00100000:3.0:1789129250.876759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129250.876898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129250.889825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129250.891641:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604582784 00000100:00100000:0.0:1789129250.891662:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604582784 00000100:00100000:0.0:1789129250.891762:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00100000:0.0:1789129250.891776:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2369:x1876037604582784:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129250.891890:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2369:x1876037604582784:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 117us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129250.891918:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 215 00000100:00080000:3.0:1789129250.892824:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129250.896667:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604582528 00000100:00100000:1.0:1789129250.896694:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604582528 00000100:00100000:1.0:1789129250.896801:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604582656 00000100:00100000:1.0:1789129250.896805:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604582656 00000100:00100000:1.0:1789129250.896843:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:1.0:1789129250.896856:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a79fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604582656:12345-192.168.201.39@tcp:400:kworker.0 00000100:00080000:3.0:1789129250.897050:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789129250.897066:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129250.897679:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a79fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2370:x1876037604582656:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 402us (20356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129250.897693:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:1.0:1789129250.897729:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:1.0:1789129250.897741:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2366:x1876037604582528:12345-192.168.201.39@tcp:9:kworker.0 00000020:00000080:1.0:1789129250.897773:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4603 00000100:00080000:1.0:1789129250.897786:0:6686:0:(import.c:65:import_set_state_nolock()) ffff90b492733000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789129250.897842:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1789129250.899765:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129250.903038:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382749a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+2:2366:x1876037604582528:12345-192.168.201.39@tcp:9:kworker.0 Request processed in 5282us (26275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129250.908848:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 72 00000100:00100000:3.0:1789129251.009051:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129251.009684:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604583040 00000100:00100000:2.0:1789129251.009700:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604583040 00000100:00100000:2.0:1789129251.009780:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:2.0:1789129251.009793:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+18:12543:x1876037604583040:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:2.0:1789129251.010995:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:12543:x1876037604583040:12345-192.168.201.39@tcp:35:umount.0 Request processed in 1193us (1951us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789129251.011010:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 66 00000100:00100000:3.0:1789129251.014564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129251.014810:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604583296 00000100:00100000:1.0:1789129251.014829:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604583296 00000100:00100000:1.0:1789129251.014928:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 67 00000100:00100000:1.0:1789129251.014941:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+19:12543:x1876037604583296:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:1.0:1789129251.015672:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:12543:x1876037604583296:12345-192.168.201.39@tcp:35:umount.0 Request processed in 728us (1121us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789129251.015683:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 67 00010000:00010000:2.0:1789129251.016237:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129251.018522:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129251.018817:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604583552 00000100:00100000:1.0:1789129251.018836:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604583552 00000100:00100000:1.0:1789129251.018930:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:1.0:1789129251.018943:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b486150c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+20:12543:x1876037604583552:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:1.0:1789129251.019928:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b486150c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:12543:x1876037604583552:12345-192.168.201.39@tcp:35:umount.0 Request processed in 981us (1419us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789129251.019941:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 68 00000100:00100000:3.0:1789129251.028038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129251.028332:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604583808 00000100:00100000:0.0:1789129251.028346:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604583808 00000100:00100000:0.0:1789129251.028726:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:0.0:1789129251.028739:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:12543:x1876037604583808:12345-192.168.201.39@tcp:35:umount.0 00000100:00100000:0.0:1789129251.029518:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:12543:x1876037604583808:12345-192.168.201.39@tcp:35:umount.0 Request processed in 777us (1493us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789129251.029530:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 69 00000100:00100000:3.0:1789129251.038317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129251.038381:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129251.038425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129251.038554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129251.038643:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604584192 00000100:00100000:0.0:1789129251.038659:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604584192 00000100:00100000:0.0:1789129251.038737:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 73 00000100:00100000:0.0:1789129251.038750:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+7:2366:x1876037604584192:12345-192.168.201.39@tcp:9:umount.0 00000020:00000080:0.0:1789129251.038803:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4864 00000020:00010000:0.0:1789129251.038815:0:6688:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b4a77ea000: total 0 00000100:00080000:0.0:1789129251.038822:0:6688:0:(import.c:65:import_set_state_nolock()) ffff90b4a77ec800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789129251.038873:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789129251.039238:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9463e625-4f12-4089-85aa-d90aafb8e5a9+5:2366:x1876037604584192:12345-192.168.201.39@tcp:9:umount.0 Request processed in 490us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129251.039247:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 73 00000020:00010000:0.0:1789129251.039277:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b4a77ea000: total 0 00010000:00010000:0.0:1789129251.039298:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b4a77ea000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789129251.039380:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000445471d/0x5c74554e47ce52a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac41 expref: 4 pid: 12455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.039425:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b424d23/0x5c74554e47ce4c07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa73 expref: 3 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.039460:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b4a77ea000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789129251.039473:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129251.039475:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129251.039477:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129251.052657:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604584448 00000100:00100000:1.0:1789129251.052682:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604584448 00000100:00100000:1.0:1789129251.052807:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604584320 00000100:00100000:1.0:1789129251.052812:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604584320 00000100:00100000:1.0:1789129251.052831:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604584576 00000100:00100000:1.0:1789129251.052834:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604584576 00000100:00100000:1.0:1789129251.052866:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:1.0:1789129251.052881:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+15:2367:x1876037604584448:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129251.052907:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129251.052958:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480031800/0x5c74554e47ce4252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa78d expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129251.052985:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129251.053091:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+14:2367:x1876037604584448:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 212us (14707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129251.053100:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:1.0:1789129251.053127:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:1.0:1789129251.053134:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+13:2367:x1876037604584320:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129251.053144:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129251.053154:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480030000/0x5c74554e47ce428a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7c5 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129251.053164:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129251.053183:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+12:2367:x1876037604584320:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 51us (14758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129251.053190:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:1.0:1789129251.053201:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789129251.053207:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+11:2367:x1876037604584576:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129251.053216:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129251.053227:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b490363200/0x5c74554e47ce453f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa89e expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129251.053237:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129251.053269:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+10:2367:x1876037604584576:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 61us (14715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129251.053275:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789129251.066765:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129251.066906:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604585600 00000100:00100000:2.0:1789129251.066922:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604585600 00000100:00100000:2.0:1789129251.067022:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 240 00000100:00100000:2.0:1789129251.067036:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b575e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+22:2366:x1876037604585600:12345-192.168.201.39@tcp:39:umount.0 00000020:00000080:2.0:1789129251.067112:0:12509:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4260 00000020:00010000:2.0:1789129251.067137:0:12509:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b4856ba800: total 0 00000100:00080000:2.0:1789129251.067145:0:12509:0:(import.c:65:import_set_state_nolock()) ffff90b4856bf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789129251.067182:0:12509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1789129251.067803:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b575e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9463e625-4f12-4089-85aa-d90aafb8e5a9+21:2366:x1876037604585600:12345-192.168.201.39@tcp:39:umount.0 Request processed in 765us (1056us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789129251.067815:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 240 00000020:00010000:0.0:1789129251.068355:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b4856ba800: total 0 00010000:00010000:0.0:1789129251.068415:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b4856ba800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789129251.068469:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789129251.068475:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789129251.068489:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ebe00/0x5c74554e47ce4bf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa6c expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068514:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129251.068517:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129251.068522:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926ea200/0x5c74554e47ce5266 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac2c expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068535:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129251.068537:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789129251.068540:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da000/0x5c74554e47ce5290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac3a expref: 18 pid: 12509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068556:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789129251.068560:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129251.068563:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86c00/0x5c74554e47ce4bc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa5e expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068672:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:0.0:1789129251.068675:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789129251.068680:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b87e00/0x5c74554e47ce48c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa99a expref: 16 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068696:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4909bd400) 00010000:00010000:0.0:1789129251.068698:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789129251.068702:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce4569 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8ac expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068724:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129251.068727:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789129251.068732:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce4c85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa96 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068746:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff90b4909bd500) 00010000:00010000:0.0:1789129251.068749:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789129251.068752:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b489b86400/0x5c74554e47ce4f64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aab68 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068771:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90b4976b8800) 00010000:00010000:0.0:1789129251.068774:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129251.068777:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eb800/0x5c74554e47ce4ae8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa26 expref: 12 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068794:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff90b4909bd200) 00010000:00010000:0.0:1789129251.068797:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789129251.068809:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce45d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8c8 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068829:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff90b4976b8600) 00010000:00010000:0.0:1789129251.068832:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129251.068835:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58da800/0x5c74554e47ce5186 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aabf4 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068853:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48544d600) 00010000:00010000:0.0:1789129251.068856:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789129251.068859:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4926eaa00/0x5c74554e47ce4c69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aaa8f expref: 9 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068871:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b49117b500) 00010000:00010000:0.0:1789129251.068874:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129251.068878:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b481656e00/0x5c74554e47ce4585 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa8b3 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129251.068906:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b4856ba800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789129251.068923:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129251.068925:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129251.068927:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129252.038440:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129252.102225:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789129252.102265:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7889e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626590336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129252.102370:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129252.102685:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626590336 00000100:00100000:3.0:1789129252.102694:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626590336 00000100:00100000:3.0:1789129252.102778:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789129252.102789:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626590336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129252.102830:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129252.102897:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626590336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129252.102905:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1789129252.103351:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129252.103405:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7889e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626590336:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789129252.703972:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1789129252.704005:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00000001:00080000:2.0:1789129252.704011:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789129252.704016:0:5862:0:(genops.c:885:class_export_put()) final put ffff90b4856ba800/9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:0.0:1789129252.704096:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4856ba800/9463e625-4f12-4089-85aa-d90aafb8e5a9 for lustre-MDT0000 00000020:00000080:0.0:1789129252.704174:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4856bf800 for lustre-MDT0000 00000001:00100000:2.0:1789129252.729075:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:2.0:1789129252.729088:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b4a77ea000/9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:2.0:1789129252.729124:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a77ea000/9463e625-4f12-4089-85aa-d90aafb8e5a9 for lustre-OST0001 00000020:00000080:2.0:1789129252.729185:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4a77ec800 for lustre-OST0001 00000100:00100000:3.0:1789129252.921154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129252.921206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129252.921264:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129252.921297:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604585728 00000100:00100000:1.0:1789129252.921320:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604585728 00000100:00100000:3.0:1789129252.921396:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129252.921416:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604585984 00000100:00100000:1.0:1789129252.921422:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604585984 00000100:00100000:1.0:1789129252.921440:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604585856 00000100:00100000:1.0:1789129252.921443:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604585856 00000100:00100000:1.0:1789129252.921470:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1789129252.921483:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+12:2370:x1876037604585728:12345-192.168.201.39@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789129252.921488:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1789129252.921514:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39f4e36-8626-43c5-a083-60799197f867+12:2370:x1876037604585984:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129252.921517:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129252.921543:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129252.921560:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b86e00/0x5c74554e47ce4332 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7da expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129252.921571:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151b000/0x5c74554e47ce4538 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa897 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129252.921597:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789129252.921599:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129252.921740:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39f4e36-8626-43c5-a083-60799197f867+10:2370:x1876037604585984:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 236us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129252.921750:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:2.0:1789129252.921792:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1789129252.921816:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39f4e36-8626-43c5-a083-60799197f867+9:2370:x1876037604585856:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129252.921829:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129252.921843:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d5000/0x5c74554e47ce4339 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa804 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129252.921858:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129252.921915:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39f4e36-8626-43c5-a083-60799197f867+8:2370:x1876037604585856:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 112us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129252.921954:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39f4e36-8626-43c5-a083-60799197f867+8:2370:x1876037604585728:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 475us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129252.922024:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604586240 00000100:00100000:0.0:1789129252.922029:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604586240 00000100:00100000:0.0:1789129252.922085:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 241 00000100:00100000:0.0:1789129252.922105:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+6:2366:x1876037604586240:12345-192.168.201.39@tcp:39:umount.0 00000020:00000080:0.0:1789129252.922146:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4347 00000020:00010000:0.0:1789129252.922171:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b4a7803000: total 0 00000100:00080000:0.0:1789129252.922179:0:5842:0:(import.c:65:import_set_state_nolock()) ffff90b4a7805000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789129252.922216:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1789129252.922783:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16cf7b7d-2f0c-40af-8c0b-6dce2288166b+5:2366:x1876037604586240:12345-192.168.201.39@tcp:39:umount.0 Request processed in 684us (1382us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789129252.922794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 241 00000020:00010000:0.0:1789129252.922831:0:5828:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b4a7803000: total 0 00010000:00010000:0.0:1789129252.922837:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129252.922885:0:5828:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b4a7803000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789129252.922920:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b48544d600) 00010000:00010000:0.0:1789129252.922924:0:5828:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789129252.922930:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b4b58dba00/0x5c74554e47ce52b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac48 expref: 4 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129252.922955:0:5828:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b4a7803000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789129252.922964:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129252.922966:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129252.922968:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789129252.923020:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129252.932978:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:1.0:1789129252.933651:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1789129252.944985:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129252.945336:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604586496 00000100:00100000:2.0:1789129252.945348:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604586496 00000100:00100000:2.0:1789129252.945410:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 348 00000100:00100000:2.0:1789129252.945421:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+7:2366:x1876037604586496:12345-192.168.201.39@tcp:251:umount.0 00000020:00000080:2.0:1789129252.945476:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce423d 00000020:00010000:2.0:1789129252.945486:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b489cb1800: total 0 00000100:00080000:2.0:1789129252.945492:0:5835:0:(import.c:65:import_set_state_nolock()) ffff90b489cb2800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789129252.945588:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39f4e36-8626-43c5-a083-60799197f867+3:2366:x1876037604586496:12345-192.168.201.39@tcp:251:umount.0 Request processed in 169us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129252.945656:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 348 00000020:00010000:1.0:1789129252.945757:0:5829:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b489cb1800: total 0 00010000:00010000:1.0:1789129252.945815:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b489cb1800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789129252.945853:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d4200/0x5c74554e47ce4291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aa7cc expref: 3 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129252.945872:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b489cb1800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789129252.945891:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129252.945893:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129252.945895:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789129252.946062:0:5835:0:(genops.c:885:class_export_put()) final put ffff90b489cb1800/f39f4e36-8626-43c5-a083-60799197f867 00000020:00000080:0.0:1789129252.946192:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90b489cb1800/f39f4e36-8626-43c5-a083-60799197f867 for MGS 00000020:00000080:0.0:1789129252.946235:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b489cb2800 for MGS 00010000:00010000:2.0:1789129253.061973:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789129253.185893:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:2.0:1789129253.185904:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b492734000/9463e625-4f12-4089-85aa-d90aafb8e5a9 00000020:00000080:1.0:1789129253.185970:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90b492734000/9463e625-4f12-4089-85aa-d90aafb8e5a9 for lustre-OST0000 00000020:00000080:1.0:1789129253.186034:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b492733000 for lustre-OST0000 00000100:00100000:2.0:1789129253.641415:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626590464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129253.641542:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129253.641703:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626590464 00000100:00100000:3.0:1789129253.641716:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626590464 00000100:00100000:3.0:1789129253.641801:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789129253.641813:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626590464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789129253.641872:0:6691:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129253.641932:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626590464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129253.641940:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1789129253.642000:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789129253.642051:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626590464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129253.642403:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382821e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626590848:0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.642448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129253.642482:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789129253.642488:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626590976:0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.642518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129253.642545:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382823840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626590592:0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.642578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129253.642631:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626591104:0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.642658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129253.642677:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129253.642682:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382820780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626590720:0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.642705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129253.642737:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626590848 00000100:00100000:0.0:1789129253.642741:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626590848 00000100:00100000:0.0:1789129253.642785:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626591104 00000100:00100000:0.0:1789129253.642789:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626591104 00000100:00100000:0.0:1789129253.642808:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626590720 00000100:00100000:0.0:1789129253.642811:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626590720 00000100:00100000:0.0:1789129253.642828:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789129253.642836:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626590848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.642881:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626590848:12345-0@lo:400:kworker.0 Request processed in 46us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129253.642889:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789129253.642904:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789129253.642911:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626591104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.642946:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626591104:12345-0@lo:400:kworker.0 Request processed in 35us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129253.642952:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789129253.642965:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789129253.642971:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626590720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.643001:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626590720:12345-0@lo:400:kworker.0 Request processed in 30us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129253.643007:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789129253.643026:0:12455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626590976 00000100:00100000:0.0:1789129253.643037:0:12455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626590976 00000100:00100000:0.0:1789129253.643068:0:12455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789129253.643075:0:12455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626590976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.643108:0:12455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626590976:12345-0@lo:400:kworker.0 Request processed in 34us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129253.643115:0:12455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789129253.643133:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626590592 00000100:00100000:0.0:1789129253.643137:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626590592 00000100:00100000:0.0:1789129253.643162:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789129253.643168:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626590592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.643201:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3306:x1876037626590592:12345-0@lo:400:kworker.0 Request processed in 34us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129253.643207:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789129253.643278:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626590976:0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.643290:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382821e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626590848:0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.643316:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382820780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626590720:0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.643324:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382823840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626590592:0@lo:400:kworker.0 00000100:00100000:0.0:1789129253.643335:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626591104:0@lo:400:kworker.0 00000100:00080000:2.0:1789129253.643821:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789129254.086751:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129255.109779:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789129255.134018:0:13410:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789129255.165383:0:13410:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789129255.165447:0:13410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.165475:0:13410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.165483:0:13410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.165501:0:13410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.165527:0:13410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789129255.165536:0:13410:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789129255.165572:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129255.165580:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.165632:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87000 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129255.165636:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.165645:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129255.165652:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129255.165658:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789129255.165661:0:8443:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789129255.165663:0:8443:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789129255.165706:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.165714:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129255.165747:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.165755:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b489b87000/0x5c74554e47ce42d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42d7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.165769:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129255.165771:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129255.165773:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789129255.165790:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789129255.165795:0:13410:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789129255.165801:0:13410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789129255.165820:0:13410:0:(import.c:65:import_set_state_nolock()) ffff90b4bab22000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789129255.166271:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7888780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626591232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789129255.166358:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129255.166626:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7889680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626591360:0@lo:39:umount.0 00000100:00100000:0.0:1789129255.166660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129255.169376:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626591360 00000100:00100000:3.0:1789129255.169402:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626591360 00000100:00100000:3.0:1789129255.169502:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789129255.169516:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383caed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876037626591360:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789129255.169559:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce404c 00000100:00080000:3.0:1789129255.169571:0:5841:0:(import.c:65:import_set_state_nolock()) ffff90b4baac0800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789129255.169716:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383caed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1876037626591360:12345-0@lo:39:umount.0 Request processed in 204us (3054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129255.169724:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1789129255.169736:0:5841:0:(genops.c:885:class_export_put()) final put ffff90b4bab20800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789129255.170426:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789129255.170492:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4bab22000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789129255.170513:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7889680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626591360:0@lo:39:umount.0 00000020:00000080:3.0:1789129255.170553:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bab20800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789129255.170645:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4baac0800 for lustre-MDT0000 00000100:00080000:0.0:1789129255.173362:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789129255.173394:0:13410:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789129255.173402:0:13410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789129255.177894:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626591232 00000100:00100000:2.0:1789129255.177911:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626591232 00000100:00100000:2.0:1789129255.177989:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789129255.178000:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4897c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+19:3307:x1876037626591232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789129255.178018:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129255.178041:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b86a00/0x5c74554e47ce42d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce42d0 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178062:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129255.178157:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4897c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:3307:x1876037626591232:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (11799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129255.178165:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1789129255.178374:0:13410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.178386:0:13410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.178392:0:13410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.178399:0:13410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.178419:0:13410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129255.178430:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129255.178436:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.178444:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b86800 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129255.178448:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.178457:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178657:0:13410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178666:0:13410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178672:0:13410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178679:0:13410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178691:0:13410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789129255.178699:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129255.178703:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178729:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b200 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129255.178732:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178739:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129255.178746:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129255.178751:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789129255.178753:0:8443:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789129255.178756:0:8443:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789129255.178796:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178802:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129255.178821:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178828:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151b200/0x5c74554e47ce41f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce41fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.178845:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129255.178847:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129255.178848:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129255.178857:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789129255.178873:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626591488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789129255.178921:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129255.178981:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626591488 00000100:00100000:2.0:1789129255.178987:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626591488 00000100:00100000:2.0:1789129255.179028:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789129255.179037:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+18:3309:x1876037626591488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789129255.179048:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129255.179060:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151bc00/0x5c74554e47ce41fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce41f7 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.179074:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129255.179104:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3309:x1876037626591488:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129255.179111:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789129255.179147:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626591488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789129255.179169:0:13410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.179177:0:13410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129255.179329:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7888780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626591232:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1789129255.179733:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129255.179739:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789129255.179741:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789129255.179765:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.179771:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789129255.179794:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.179801:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b489b86800/0x5c74554e47ce42de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42e5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.179813:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129255.179814:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129255.179816:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129255.179823:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129255.179832:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7899680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626591616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129255.179875:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129255.179911:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626591616 00000100:00100000:1.0:1789129255.179917:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626591616 00000100:00100000:1.0:1789129255.179956:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789129255.179964:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3308:x1876037626591616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789129255.179977:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129255.179988:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d5400/0x5c74554e47ce42e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce42de expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.180010:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129255.180040:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c52940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3308:x1876037626591616:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129255.180047:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789129255.180078:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7899680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626591616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789129255.182320:0:13410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.182331:0:13410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.182364:0:13410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789129255.182375:0:13410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.182403:0:13410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.182409:0:13410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.182415:0:13410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129255.182435:0:13410:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789129255.182440:0:13410:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789129255.182446:0:13410:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1789129255.182641:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789129255.182650:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.182658:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b481656600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789129255.182662:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.182671:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129255.182679:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129255.182684:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789129255.182687:0:8443:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789129255.182689:0:8443:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789129255.182730:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.182737:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789129255.182763:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.182771:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b481656600/0x5c74554e47ce452a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce4531 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.182793:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129255.182803:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.182809:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789129255.182812:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.182819:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129255.182826:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129255.182831:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789129255.182833:0:8443:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789129255.182836:0:8443:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789129255.182850:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.182857:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789129255.182863:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.182870:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b48151b600/0x5c74554e47ce3fab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce3fb2 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.182885:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129255.182887:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129255.182889:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129255.182907:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626591744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789129255.182974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129255.183034:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129255.183041:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626591872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789129255.183065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129255.183098:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626591744 00000100:00100000:0.0:1789129255.183108:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626591744 00000100:00100000:0.0:1789129255.183149:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626591872 00000100:00100000:0.0:1789129255.183152:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626591872 00000100:00100000:0.0:1789129255.183175:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789129255.183313:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789129255.183323:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383caf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+17:3306:x1876037626591872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789129255.183336:0:8444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129255.183351:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480030a00/0x5c74554e47ce3fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce3fab expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129255.183366:0:8444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129255.183406:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383caf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4a927c41-01d5-424a-b17c-4bdb2d4e760d+16:3306:x1876037626591872:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129255.183414:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789129255.183451:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626591872:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1789129255.184095:0:13410:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789129255.184101:0:13410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789129255.184106:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789129255.184112:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1789129255.184118:0:13410:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90b4c094f800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789129255.184125:0:13410:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90b38196a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789129255.184132:0:13410:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff90b4a7803000 16cf7b7d-2f0c-40af-8c0b-6dce2288166b 192.168.201.39@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789129255.184137:0:13410:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90b486428000) has exports, disconnecting them 00000020:00080000:2.0:1789129255.184140:0:13410:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90b4c094f800), last request at 1789129253 00000020:00000080:2.0:1789129255.184148:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce41bf 00000100:00080000:2.0:1789129255.184166:0:13410:0:(import.c:65:import_set_state_nolock()) ffff90b4c094e800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789129255.184468:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129255.184637:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789129255.184938:0:13410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b4c094f800): rc 0 00000020:00000080:2.0:1789129255.184943:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4c094f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789129255.184962:0:13410:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90b38196a800), last request at 1789129253 00000020:00000080:2.0:1789129255.184966:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce40f4 00000100:00080000:2.0:1789129255.184983:0:13410:0:(import.c:65:import_set_state_nolock()) ffff90b381969800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789129255.185000:0:13410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b38196a800): rc 0 00000020:00000080:2.0:1789129255.185003:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b38196a800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789129255.185011:0:13410:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb11203af3ae0 00000100:00080000:2.0:1789129255.185036:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789129255.185040:0:13410:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789129255.185055:0:13410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789129255.185129:0:13410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789129255.185152:0:13410:0:(import.c:65:import_set_state_nolock()) ffff90b485d0a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789129255.185165:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789129255.185168:0:13410:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789129255.185173:0:13410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789129255.185260:0:13410:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789129255.185268:0:13410:0:(import.c:65:import_set_state_nolock()) ffff90b489cb7000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789129255.185296:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90b486428000) has no exports 00000100:00100000:0.0:1789129255.185361:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cacb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+15:3306:x1876037626591744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789129255.185378:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129255.185395:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b48151ba00/0x5c74554e47ce4531 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce452a expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129255.185409:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129255.185488:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cacb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:3306:x1876037626591744:12345-0@lo:103:ldlm_bl.0 Request processed in 2305us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129255.185497:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1789129255.185843:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789129255.185961:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c094f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789129255.186011:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b38196a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789129255.186034:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c094e800 for lustre-MDT0000 00000020:00000080:3.0:1789129255.186039:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b381969800 for lustre-MDT0000 00000100:00100000:3.0:1789129255.186061:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626592000:0@lo:9:umount.0 00000100:00100000:3.0:1789129255.186111:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129255.186140:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7888b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626592128:0@lo:9:umount.0 00000100:00100000:3.0:1789129255.186162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129255.186206:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626592000 00000100:00100000:3.0:1789129255.186214:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626592000 00000100:00100000:3.0:1789129255.186266:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626592128 00000100:00100000:3.0:1789129255.186269:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626592128 00000100:00100000:3.0:1789129255.186286:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789129255.186293:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876037626592000:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789129255.186315:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4141 00000100:00080000:3.0:1789129255.186321:0:6688:0:(import.c:65:import_set_state_nolock()) ffff90b3812ff000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789129255.186355:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789129255.186978:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3305:x1876037626592000:12345-0@lo:9:umount.0 Request processed in 682us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129255.186988:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789129255.187006:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789129255.187013:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876037626592128:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789129255.187027:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4228 00000100:00080000:3.0:1789129255.187033:0:6688:0:(import.c:65:import_set_state_nolock()) ffff90b4c094c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789129255.187056:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789129255.187266:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3305:x1876037626592128:12345-0@lo:9:umount.0 Request processed in 253us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129255.187290:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789129255.187313:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789129255.187317:0:5836:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789129255.187332:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129255.187337:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129255.187498:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3306:1876037626591744:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789129255.188850:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d0a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789129255.188875:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789129255.188878:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789129255.188882:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626592000:0@lo:9:umount.0 00000100:00080000:1.0:1789129255.188899:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b489cb7000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789129255.188910:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789129255.188912:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789129255.188914:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7888b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626592128:0@lo:9:umount.0 00000020:00080000:0.0:1789129255.195062:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90b486428000) has no exports 00000020:00000080:0.0:1789129255.309507:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4006 00000020:00000080:0.0:1789129255.309530:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b489ca8800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789129255.309549:0:13410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789129255.309789:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b489ca8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789129255.309816:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789129255.309826:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789129255.309829:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90b4bb024ed8) has no exports 00000020:00000080:1.0:1789129255.313175:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce3fff 00000020:00000080:1.0:1789129255.313196:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4c18e6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789129255.313313:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789129255.313329:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789129255.313332:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4c18e0800/lustre-QMT0000_UUID 00000020:00000080:1.0:1789129255.313335:0:13410:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c18e0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789129255.313343:0:13410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789129255.313752:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c18e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1789129256.135865:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129257.161738:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789129257.803015:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 16cf7b7d-2f0c-40af-8c0b-6dce2288166b 00000001:00080000:2.0:1789129257.803043:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789129257.803049:0:5862:0:(genops.c:885:class_export_put()) final put ffff90b4a7803000/16cf7b7d-2f0c-40af-8c0b-6dce2288166b 00000020:00000080:2.0:1789129257.803079:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7803000/16cf7b7d-2f0c-40af-8c0b-6dce2288166b for lustre-MDT0000 00000020:00000080:2.0:1789129257.803172:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4a7805000 for lustre-MDT0000 00000001:00100000:2.0:1789129257.839448:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789129257.839463:0:7637:0:(genops.c:885:class_export_put()) final put ffff90b4c0948800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789129257.839560:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c0948800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789129257.839655:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4c094c000 for lustre-OST0001 00010000:00010000:3.0:1789129258.181879:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789129258.295102:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789129258.295116:0:6712:0:(genops.c:885:class_export_put()) final put ffff90b3812fe000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789129258.295252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812fe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789129258.295314:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b3812ff000 for lustre-OST0000 00000100:00100000:0.0:1789129258.759789:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626592384:0@lo:400:kworker.0 00000100:00100000:1.0:1789129258.759803:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626592256:0@lo:400:kworker.0 00000100:00100000:2.0:1789129258.759933:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626592512:0@lo:400:kworker.0 00000100:00100000:0.0:1789129258.761282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129258.761779:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626592384 00000100:00100000:3.0:1789129258.761793:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626592384 00000100:00100000:1.0:1789129258.761827:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129258.761848:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789129258.761858:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876037626592384:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789129258.761870:0:5840:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789129258.761885:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626592256 00000100:00100000:1.0:1789129258.761888:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626592256 00000100:00100000:1.0:1789129258.761920:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789129258.761925:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1876037626592384:12345-0@lo:400:kworker.0 Request processed in 67us (650us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789129258.761926:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:3308:x1876037626592256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129258.761932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789129258.761975:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4903c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4a927c41-01d5-424a-b17c-4bdb2d4e760d+14:3308:x1876037626592256:12345-0@lo:400:kworker.0 Request processed in 49us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129258.761982:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789129258.762005:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626592256:0@lo:400:kworker.0 00000100:00080000:0.0:1789129258.762116:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789129258.762124:0:3309:0:(import.c:65:import_set_state_nolock()) ffff90b381968800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789129258.762128:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789129258.762294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129258.762393:0:12509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626592512 00000100:00100000:3.0:1789129258.762398:0:12509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626592512 00000100:00100000:3.0:1789129258.762430:0:12509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789129258.762435:0:12509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3306:x1876037626592512:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789129258.762441:0:12509:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789129258.762682:0:12509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3306:x1876037626592512:12345-0@lo:400:kworker.0 Request processed in 244us (387us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789129258.762698:0:12509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1789129258.762767:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789129258.762772:0:3306:0:(import.c:65:import_set_state_nolock()) ffff90b4a7802800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789129258.762783:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789129258.762790:0:3306:0:(import.c:65:import_set_state_nolock()) ffff90b4a7802800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789129258.762794:0:3306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 186 00000100:00080000:2.0:1789129258.762804:0:3306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90b4a7802800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1789129258.762846:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4a78883c0 x1876037626592640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789129258.762869:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626592512:0@lo:400:kworker.0 00000100:00100000:1.0:1789129258.762944:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626592640:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789129258.762979:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129258.763055:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626592640 00000100:00100000:3.0:1789129258.763059:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626592640 00000100:00100000:3.0:1789129258.763219:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789129258.763225:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1876037626592640:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1789129258.763247:0:6710:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789129258.783371:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1876037626592640:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 20123us (20370us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789129258.783390:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1789129258.784860:0:3309:0:(import.c:65:import_set_state_nolock()) ffff90b381968800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789129258.784875:0:3309:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 163 00000100:00080000:0.0:1789129258.784888:0:3309:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90b381968800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789129258.784939:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b383caf840 x1876037626592768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789129258.784967:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626592384:0@lo:400:kworker.0 00000100:00100000:1.0:1789129258.785072:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626592768:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789129258.785159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789129258.785239:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4a7802800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789129258.785245:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789129258.785269:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626592640:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789129258.785721:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626592768 00000100:00100000:0.0:1789129258.785729:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626592768 00000100:00100000:0.0:1789129258.785780:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789129258.785790:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876037626592768:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1789129258.785813:0:5842:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789129258.785876:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876037626592768:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 85us (717us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789129258.785884:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1789129258.786785:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b381968800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789129258.786795:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789129258.786800:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626592768:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1789129259.207094:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129260.229943:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129261.255483:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789129261.383821:0:13410:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b49024f2a0 - data ffff90b4a27c5948/ffff90b381240400 00000020:01000000:2.0:1789129261.384012:0:13410:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b492183000 - data ffff90b4a2411870/ffff90b4bab30000 00000001:00000004:2.0:1789129261.400939:0:13410:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1789129261.484932:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789129261.484944:0:13410:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789129261.484961:0:13410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789129261.484963:0:13410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789129261.487583:0:6873:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789129261.487595:0:6873:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789129261.487634:0:6873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789129261.489412:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789129261.489422:0:13410:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789129261.489447:0:13410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789129261.489450:0:13410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789129261.489813:0:8071:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789129261.489820:0:8071:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1789129261.489833:0:8071:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789129261.640451:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce3fce 00000020:00000080:3.0:1789129261.640471:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4bb010800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789129261.640698:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bb010800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789129261.645491:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce3fe3 00000020:00000080:3.0:1789129261.645513:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4bb015000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789129261.645535:0:13410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789129261.645545:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789129261.645556:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789129261.645562:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90b48642ced8) has no exports 00000004:01000000:3.0:1789129261.645804:0:13410:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789129261.645815:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4221 00000020:00000080:3.0:1789129261.645820:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4856bb000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789129261.645824:0:13410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789129261.645828:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789129261.645835:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789129261.645838:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff90b4b5761a48) has no exports 00000020:00000080:3.0:1789129261.645859:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce421a 00000020:00000080:3.0:1789129261.645864:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b489cb4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789129261.646187:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bb015000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789129261.646199:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4856bb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789129261.646205:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b489cb4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789129261.646888:0:13410:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789129261.646896:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789129261.646901:0:13410:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1789129261.646910:0:13410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789129261.646913:0:13410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789129261.646989:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129261.647002:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789129261.647010:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce413a 00000020:00000080:3.0:1789129261.647018:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b485d0d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789129261.647026:0:13410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789129261.647030:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789129261.647034:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789129261.647036:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90b4b5760000) has no exports 00000020:00000080:3.0:1789129261.647042:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce4133 00000020:00000080:3.0:1789129261.647045:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b485d0c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789129261.647162:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b489cb7000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789129261.647184:0:38:0:(genops.c:885:class_export_put()) final put ffff90b489cb0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789129261.647196:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b489cb0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789129261.647202:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789129261.647297:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b485d0d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789129261.647303:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b485d0c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789129261.648792:0:13410:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789129261.648805:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789129261.648811:0:13410:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1789129261.648820:0:13410:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789129261.648823:0:13410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789129261.648899:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129261.648913:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789129261.648956:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129261.648961:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789129261.648970:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4bab26800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789129261.648977:0:13410:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bab26800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789129261.648986:0:13410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789129261.650400:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce3fea 00000020:00000080:3.0:1789129261.650420:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4bb010000/lustre-MDD0000_UUID 00000020:01000000:3.0:1789129261.650447:0:13410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789129261.650453:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789129261.650463:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789129261.650468:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90b4bb023490) has no exports 00000020:00000080:3.0:1789129261.650500:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129261.650506:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789129261.650511:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce3ff1 00000020:00000080:3.0:1789129261.650517:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4bb015800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789129261.650527:0:13410:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b4921dd800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789129261.650531:0:13410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4921dd800 3 00000020:01000004:3.0:1789129261.650535:0:13410:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90b4921dd800 from lustre-MDT0000 00000020:00000080:3.0:1789129261.650558:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129261.650562:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789129261.650564:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4bb013000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789129261.650568:0:13410:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bb013000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789129261.650581:0:13410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789129261.650643:0:13410:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1789129261.650648:0:13410:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789129261.650651:0:13410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789129261.650654:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789129261.650657:0:13410:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789129261.650666:0:13410:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90b488103000 4a927c41-01d5-424a-b17c-4bdb2d4e760d 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789129261.650673:0:13410:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90b48642b490) has exports, disconnecting them 00000020:00080000:3.0:1789129261.650678:0:13410:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90b488103000), last request at 1789128977 00000020:00000080:3.0:1789129261.650697:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce3f88 00000020:00010000:3.0:1789129261.650702:0:13410:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90b488103000: total 2 00000100:00080000:3.0:1789129261.650708:0:13410:0:(import.c:65:import_set_state_nolock()) ffff90b488100000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789129261.650733:0:13410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b488103000): rc 0 00000020:00080000:3.0:1789129261.650738:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90b48642b490) has no exports 00000100:00100000:3.0:1789129261.650826:0:5833:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90b487c49600:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1789129261.650938:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90b487c49200:5834] 1 exiting: rc = 0 00000020:00010000:1.0:1789129261.651002:0:8443:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90b488103000: total 2 00010000:00010000:1.0:1789129261.651045:0:8443:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90b488103000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789129261.651082:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b87200/0x5c74554e47ce42f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce42ec expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129261.651101:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4829d4e00/0x5c74554e47ce429f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce4298 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129261.651113:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b489b86600/0x5c74554e47ce42ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce42a6 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129261.651154:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce42c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce42c2 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129261.651166:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480030400/0x5c74554e47ce42bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce42b4 expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129261.651183:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656800/0x5c74554e47ce4523 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce451c expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129261.651204:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480030c00/0x5c74554e47ce40a7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce40a0 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129261.651217:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b481656a00/0x5c74554e47ce4515 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5c74554e47ce450e expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129261.651240:0:8443:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90b488103000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789129261.651253:0:8443:0:(genops.c:885:class_export_put()) final put ffff90b488103000/4a927c41-01d5-424a-b17c-4bdb2d4e760d 00010000:00010000:1.0:1789129261.651260:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129261.651263:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129261.651265:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789129261.651291:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b485d0a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789129261.651301:0:38:0:(genops.c:885:class_export_put()) final put ffff90b485d0b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789129261.651303:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b485d0b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1789129261.651305:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90b487c49a00:5835] 2 exiting: rc = 0 00000020:01000000:0.0:1789129261.651309:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789129261.651438:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bb010000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789129261.651443:0:38:0:(genops.c:885:class_export_put()) final put ffff90b4bb017000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789129261.651445:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bb017000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789129261.651453:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789129261.651650:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bb015800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789129261.651654:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b488103000/4a927c41-01d5-424a-b17c-4bdb2d4e760d for MGS 00000020:00000080:0.0:1789129261.651693:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b488100000 for MGS 00000100:00100000:3.0:1789129261.652243:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652268:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652276:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652287:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652294:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652301:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652307:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652313:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652321:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652328:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652334:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652341:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652348:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652356:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652362:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652369:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652375:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652381:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652386:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652393:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652399:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652406:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652412:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652418:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652423:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652430:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652436:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652441:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652447:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652454:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652460:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652466:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652472:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652478:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652484:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652490:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652504:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652510:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652516:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652522:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652528:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652534:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652540:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652546:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652552:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652557:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652562:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652568:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652573:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652578:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652583:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652588:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652595:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652627:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652634:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652639:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652644:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652650:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652655:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652661:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652666:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652671:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652677:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.652682:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1789129261.653086:0:13410:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789129261.653090:0:13410:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1789129261.654458:0:13410:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b4c0db8240 - data ffff90b4a2408948/ffff90b4a782a000 00000020:01000000:3.0:1789129261.654632:0:13410:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b48855e540 - data ffff90b4a24111b0/ffff90b487ca6800 00000020:00000080:3.0:1789129261.655193:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce3f73 00000020:00000080:3.0:1789129261.655203:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4921db800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789129261.655222:0:13410:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b4921dd800 from MGS, refs=2 00000020:01000004:3.0:1789129261.655239:0:13410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4921dd800 2 00000020:01000004:3.0:1789129261.655243:0:13410:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90b4921dd800 from MGS 00000020:00000080:3.0:1789129261.655269:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129261.655276:0:13410:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789129261.655279:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4921dc000/MGS 00000020:00000080:3.0:1789129261.655283:0:13410:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4921dc000/MGS for MGS 00000020:01000000:3.0:1789129261.655291:0:13410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789129261.655366:0:13410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789129261.655372:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789129261.655378:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789129261.655387:0:13410:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90b4bab25800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789129261.655394:0:13410:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff90b487c74ed8) has exports, disconnecting them 00000020:00080000:3.0:1789129261.655399:0:13410:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90b4bab25800), last request at 1789128978 00000020:00000080:3.0:1789129261.655404:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce403e 00000020:00080000:3.0:1789129261.655415:0:13410:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b4bab25800): rc 0 00000020:00000080:3.0:1789129261.655420:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4bab25800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789129261.655506:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4921db800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789129261.655515:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bab25800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789129261.673693:0:13410:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789129261.673711:0:13410:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789129261.673719:0:13410:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789129261.673732:0:13410:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789129261.673990:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789129261.674002:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789129261.674010:0:13410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4921dd800 1 00000020:00000080:0.0:1789129261.674018:0:13410:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce3f65 00000020:00000080:0.0:1789129261.674030:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4921da000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789129261.674037:0:13410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789129261.674045:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789129261.674050:0:13410:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789129261.674054:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90b486429a48) has no exports 00000020:00000080:1.0:1789129261.674148:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4bab22000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789129261.674157:0:36:0:(genops.c:885:class_export_put()) final put ffff90b4bab22800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789129261.674161:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4bab22800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789129261.674190:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789129261.674274:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4921da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789129261.791527:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789129261.791560:0:13410:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789129261.791568:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b4921d9800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789129261.791575:0:13410:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4921d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789129261.791587:0:13410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789129261.791755:0:13410:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90b4921de000 00000020:01000000:0.0:1789129261.791786:0:13410:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789129261.791790:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789129261.791795:0:13410:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789129261.791800:0:13410:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90b487cb3490) has no exports 00000100:00100000:0.0:1789129261.791905:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90b484c7d800:5842] 2 exiting: rc = 0 00000100:00100000:3.0:1789129261.792049:0:12509:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff90b483a53600:12509] 4 exiting: rc = 0 00000100:00100000:3.0:1789129261.792184:0:5841:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff90b48997e000:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1789129261.792445:0:6710:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90b490360600:6710] 3 exiting: rc = 0 00000100:00100000:0.0:1789129261.794842:0:5840:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90b48997ee00:5840] 0 exiting: rc = 1 00000100:00100000:3.0:1789129261.795345:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795357:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795365:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795372:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795378:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795384:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795392:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795400:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795407:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795415:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795421:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795428:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795436:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795442:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795461:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795467:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795474:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795481:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795487:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795494:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795499:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795505:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795511:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795517:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795523:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795530:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795536:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795543:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795550:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795556:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795563:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795570:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795576:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795582:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795588:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795594:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795613:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795620:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795626:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795632:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795638:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795645:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795650:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795656:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795662:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795668:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795675:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795680:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795686:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795698:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795704:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795710:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795715:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795721:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795727:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795732:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795739:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795745:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795751:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795756:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795762:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795768:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795775:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.795781:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129261.802630:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90b485d61e00:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1789129261.802633:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90b485d60600:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1789129261.803128:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803140:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803149:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803156:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803270:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803278:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803289:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803295:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803303:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803310:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803316:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803325:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803333:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803339:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803345:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803351:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803358:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803364:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803371:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803376:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803398:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803404:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803410:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803417:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803423:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803429:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803436:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803443:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803448:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803454:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803461:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803468:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803474:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803481:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803487:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803493:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803500:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803505:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803511:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803517:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803523:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803529:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803535:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803542:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803548:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803554:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803560:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803566:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803572:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803579:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803585:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803591:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803596:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803887:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803896:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803910:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.803998:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.804006:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.804012:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.804019:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.804026:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.804033:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.804039:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.804046:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129261.804693:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90b488b1aa00:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1789129261.805733:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90b488b1b800:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1789129261.805890:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.805902:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.805991:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806017:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806024:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806030:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806036:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806044:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806051:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806058:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806066:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806072:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806079:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806085:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806092:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806126:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806139:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806146:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806158:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806165:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806171:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806178:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806185:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806192:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806199:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806205:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806227:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806248:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806255:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806263:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806269:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806278:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806285:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806293:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806300:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806309:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806316:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806328:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806335:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806359:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806366:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806373:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806381:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806387:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806393:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806400:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806410:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806416:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806423:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806429:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806437:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806458:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806466:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806473:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806480:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806487:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806494:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806500:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806507:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806515:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806521:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806535:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806541:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.806550:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789129261.834024:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90b488b1be00:5848] 1 exiting: rc = 0 00000100:00100000:0.0:1789129261.834024:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90b488b1bc00:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1789129261.836512:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836525:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836532:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836538:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836544:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836551:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836558:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836563:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836569:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836575:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836581:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836587:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836593:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836598:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836621:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836627:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836634:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836640:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836646:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836652:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836658:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836665:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836671:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836676:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836682:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836688:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836694:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836701:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836707:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836713:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836718:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836724:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836747:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836754:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836761:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836768:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836774:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836780:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836787:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836793:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836799:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836805:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836811:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836818:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836823:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836829:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836835:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836841:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836847:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836853:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836860:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836866:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836873:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836879:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836885:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836891:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836897:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836902:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836908:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836914:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836920:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836925:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836932:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.836938:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.837888:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90b488b1a000:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1789129261.844003:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90b488b1ae00:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1789129261.844229:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844254:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844260:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844267:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844274:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844279:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844285:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844291:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844298:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844303:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844309:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844315:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844321:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844326:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844344:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844349:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844355:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844360:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844365:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844370:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844376:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844381:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844386:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844392:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844397:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844403:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844408:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844414:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844419:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844425:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844431:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844436:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844441:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844447:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844453:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844459:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844472:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844478:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844487:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844493:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844499:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844505:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844511:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844517:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844523:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844528:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844535:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844540:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844546:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844552:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844558:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844564:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844570:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844576:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844581:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844587:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844593:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844598:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844639:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844644:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844650:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844655:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844662:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.844668:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.845149:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff90b489950000:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1789129261.847318:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90b488b1b400:5851] 0 exiting: rc = 1 00000100:00100000:3.0:1789129261.851424:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851439:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851446:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851453:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851459:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851465:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851498:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851504:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851509:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851514:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851520:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851528:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851536:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851543:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851550:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851556:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851562:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851569:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851576:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851583:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851589:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851596:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851746:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851753:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851759:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851765:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851772:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851777:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851783:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851789:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851795:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851802:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851808:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851815:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851822:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851828:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851835:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851841:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851847:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851853:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851859:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851874:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851880:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851887:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851893:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851899:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851905:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851911:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851918:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851925:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851931:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851937:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851942:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851948:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851954:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851960:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851966:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851972:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851978:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851984:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851990:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.851995:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.852002:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.852008:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.857646:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff90b489954400:5855] 2 exiting: rc = 0 00000100:00100000:1.0:1789129261.857685:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff90b488b1b000:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1789129261.858015:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff90b488b1ac00:5854] 1 exiting: rc = 0 00000100:00100000:3.0:1789129261.865017:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865031:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865038:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865044:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865051:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865057:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865064:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865071:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865078:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865123:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865132:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865151:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865157:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865163:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865169:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865176:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865184:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865192:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865201:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865214:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865222:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865229:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865236:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865242:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865249:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865256:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865262:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865269:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865275:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865280:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865287:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865293:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865299:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865323:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865346:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865355:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865361:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865367:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865374:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865380:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865387:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865394:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865403:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865409:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865417:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865426:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865440:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865446:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865452:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865458:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865465:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865473:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865480:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865486:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865493:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865500:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865506:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865513:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865520:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865527:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865535:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865542:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865549:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129261.865556:0:13410:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789129261.881204:0:13410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129261.881226:0:13410:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789129261.881234:0:13410:0:(genops.c:885:class_export_put()) final put ffff90b488105000/MDS_uuid 00000020:00000080:3.0:1789129261.881240:0:13410:0:(genops.c:844:class_export_destroy()) destroying export ffff90b488105000/MDS_uuid for MDS 00000020:01000000:3.0:1789129261.881246:0:13410:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789129261.881428:0:13410:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789129262.277939:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129263.302898:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789129263.882504:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789129263.882514:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789129263.882518:0:38:0:(import.c:65:import_set_state_nolock()) ffff90b381968800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789129263.882526:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 421 00000100:00080000:0.0:1789129263.882534:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789129263.882542:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90b381968800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789129263.882573:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b383cad2c0 x1876037626593024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789129263.882590:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789129263.882594:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789129263.882596:0:38:0:(import.c:65:import_set_state_nolock()) ffff90b4a7802800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1789129263.882882:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626592896:0@lo:400:kworker.0 00000400:00000100:1.0:1789129263.882942:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876037626592896 offset 0 length 224: 4 00000100:00100000:1.0:1789129263.883006:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626593024:0@lo:38:kworker.0 00000400:00000100:1.0:1789129263.883096:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876037626593024 offset 0 length 520: 4 00000100:00080000:0.0:1789129263.883226:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 421 00000100:00080000:0.0:1789129263.883239:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789129263.883245:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90b4a7802800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1789129263.883335:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4a7888780 x1876037626593152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789129263.883402:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7888780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626593152:0@lo:38:kworker.0 00000400:00000100:1.0:1789129263.883424:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876037626593152 offset 0 length 520: 4 00010000:00010000:1.0:1789129264.325810:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129265.349917:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789129265.742549:0:13566:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789129265.763239:0:13566:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789129265.763289:0:13566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129265.763306:0:13566:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129265.763315:0:13566:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129265.763322:0:13566:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129265.763341:0:13566:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789129265.763346:0:13566:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789129265.763374:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129265.763380:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129265.763387:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031e00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129265.763392:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129265.763401:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789129265.763405:0:13566:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:1.0:1789129265.763408:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129265.763433:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789129265.763436:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789129265.763438:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1789129265.764586:0:13566:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b383cad2c0 x1876037626593024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789129278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129265.764636:0:13566:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789129265.764644:0:13566:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1789129265.764648:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789129265.764652:0:13566:0:(import.c:65:import_set_state_nolock()) ffff90b381968800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789129265.764659:0:13566:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789129265.764673:0:13566:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b383cad2c0 x1876037626593024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789129278 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129265.764680:0:13566:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789129265.764683:0:13566:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1789129265.764872:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789129265.764954:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626593280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789129265.765032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129265.765239:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626593024:0@lo:38:kworker.0 00010000:00010000:1.0:1789129265.767141:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129265.767160:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b480031e00/0x5c74554e47ce42b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42bb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129265.767221:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626593280 00000100:00100000:1.0:1789129265.767231:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626593280 00000100:00100000:1.0:1789129265.767284:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789129265.767291:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1876037626593280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789129265.767298:0:5825:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789129265 with bad export cookie 6662043543488315272 00010000:00010000:2.0:1789129265.773160:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129265.773171:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129265.773175:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129265.774499:0:13566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129265.774518:0:13566:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129265.774548:0:13566:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129265.774554:0:13566:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129265.775055:0:13566:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789129265.775070:0:13566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129265.775079:0:13566:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129265.775086:0:13566:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129265.775093:0:13566:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.782415:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789129265.782432:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.782444:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031c00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789129265.782449:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.782460:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789129265.782497:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129265.782504:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789129265.782508:0:8443:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1789129265.782569:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.782593:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789129265.782974:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626593408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789129265.783069:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129265.783155:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626593408 00000100:00100000:0.0:1789129265.783163:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626593408 00000100:00100000:0.0:1789129265.783208:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789129265.783215:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1876037626593408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789129265.783221:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789129265 with bad export cookie 6662043543488315272 00000100:00100000:0.0:1789129265.783267:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383caf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3309:x1876037626593408:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (197us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789129265.783274:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789129265.783311:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789129265.783325:0:3309:0:(import.c:65:import_set_state_nolock()) ffff90b489c88800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789129265.783329:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1789129265.783370:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.783379:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b480031c00/0x5c74554e47ce42c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce42c9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.783397:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129265.783402:0:8443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.783408:0:8443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362200 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789129265.783412:0:8443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.783419:0:8443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789129265.783427:0:8443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129265.783433:0:8443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789129265.783443:0:8443:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1789129265.783516:0:13566:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:2.0:1789129265.783525:0:13566:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1789129265.783531:0:13566:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789129265.783534:0:13566:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789129265.783564:0:13566:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789129265.783569:0:13566:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789129265.783575:0:13566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789129265.783581:0:13566:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789129265.783586:0:13566:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90b4bb020000) has no exports 00000020:00080000:2.0:1789129265.783879:0:13566:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90b4bb020000) has no exports 00000020:01000000:2.0:1789129265.785825:0:13566:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b4885f4780 - data ffff90b4bfe33af8/ffff90b382827400 00000020:01000000:2.0:1789129265.786006:0:13566:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b4885f4240 - data ffff90b4a27c1000/ffff90b3812f0c00 00010000:00010000:1.0:1789129265.791875:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129265.810924:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cae940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1876037626593280:12345-0@lo:103:ldlm_bl.0 Request processed in 43621us (45881us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789129265.810941:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789129265.825959:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.139@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789129265.825967:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789129265.825977:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b383cae580 x1876037626592896/t0(0) o400->MGC192.168.201.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789129279 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789129265.826138:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1789129265.826182:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b4bae7a940 x1876037626593280/t0(0) o103->MGC192.168.201.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789129281 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129265.826193:0:3309:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b4bacd0f00 x1876037626593408/t0(0) o103->MGC192.168.201.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789129281 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789129265.826202:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789129265.826204:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789129265.826205:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789129265.827433:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3307:1876037626592896:0@lo:400:kworker.0 00010000:00010000:3.0:1789129265.829337:0:8443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.829356:0:8443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789129265.829387:0:8443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.829395:0:8443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce451c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5c74554e47ce4523 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129265.829416:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129265.829418:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129265.829421:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129265.829442:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4a927c41-01d5-424a-b17c-4bdb2d4e760d:0:1876037626593536:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789129265.832589:0:3308:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90b489c88800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1789129265.834117:0:3309:0:(import.c:65:import_set_state_nolock()) ffff90b489c88800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789129265.834130:0:3309:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 140 00000100:00080000:0.0:1789129265.834141:0:3309:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import ffff90b489c88800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789129265.834210:0:3309:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b383cada40 x1876037626593664/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789129265.834267:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3309:1876037626593408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789129265.834402:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3305:1876037626593664:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1789129265.834470:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876037626593664 offset 0 length 520: 4 00000100:00100000:2.0:1789129265.834625:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3308:1876037626593280:0@lo:103:ldlm_bl.0 00100000:10000000:3.0:1789129265.851458:0:13566:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789129265.944776:0:13566:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce40c3 00000020:00000080:0.0:1789129265.944792:0:13566:0:(genops.c:885:class_export_put()) final put ffff90b3812f9000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789129265.944815:0:13566:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b492084000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789129265.944819:0:13566:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b492084000 2 00000020:01000004:0.0:1789129265.944823:0:13566:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90b492084000 from lustre-OST0000 00000020:00000080:0.0:1789129265.944851:0:13566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789129265.944861:0:13566:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789129265.944864:0:13566:0:(genops.c:885:class_export_put()) final put ffff90b48303d800/lustre-OST0000_UUID 00000020:00000080:0.0:1789129265.944867:0:13566:0:(genops.c:844:class_export_destroy()) destroying export ffff90b48303d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789129265.944890:0:13566:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789129265.944940:0:13566:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789129265.944945:0:13566:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789129265.944950:0:13566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789129265.944955:0:13566:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789129265.944962:0:13566:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90b38196b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789129265.944968:0:13566:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff90b487c71a48) has exports, disconnecting them 00000020:00080000:0.0:1789129265.944973:0:13566:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90b38196b000), last request at 1789129000 00000020:00000080:0.0:1789129265.944978:0:13566:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce40ed 00000020:00080000:0.0:1789129265.944989:0:13566:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b38196b000): rc 0 00000020:00000080:0.0:1789129265.945007:0:13566:0:(genops.c:885:class_export_put()) final put ffff90b38196b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789129265.946055:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812f9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789129265.946080:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b38196b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789129265.946252:0:13566:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789129265.946257:0:13566:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789129265.946263:0:13566:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789129265.946270:0:13566:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789129265.946466:0:13566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789129265.946472:0:13566:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789129265.946479:0:13566:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b492084000 1 00000020:00000080:0.0:1789129265.946484:0:13566:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce407d 00000020:00000080:0.0:1789129265.946495:0:13566:0:(genops.c:885:class_export_put()) final put ffff90b488b5e800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789129265.946502:0:13566:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789129265.946511:0:13566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789129265.946514:0:13566:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789129265.946518:0:13566:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff90b487cb4ed8) has no exports 00000020:00000080:3.0:1789129265.946679:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b381968800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789129265.946688:0:38:0:(genops.c:885:class_export_put()) final put ffff90b4a7a4a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789129265.946691:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7a4a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789129265.946698:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789129265.946765:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90b488b5e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789129265.971652:0:13566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129265.972975:0:13566:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789129265.972997:0:13566:0:(genops.c:885:class_export_put()) final put ffff90b492087800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789129265.973020:0:13566:0:(genops.c:844:class_export_destroy()) destroying export ffff90b492087800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789129265.973034:0:13566:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789129265.973210:0:13566:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90b492082800 00000020:02000400:3.0:1789129265.973263:0:13566:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789129266.373910:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129267.398265:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129268.426967:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789129268.998284:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4a927c41-01d5-424a-b17c-4bdb2d4e760d->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789129268.998298:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4a927c41-01d5-424a-b17c-4bdb2d4e760d->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789129268.998301:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789129268.998304:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:2.0:1789129269.283581:0:13717:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789129269.314275:0:13717:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789129269.314370:0:13717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.314385:0:13717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.314393:0:13717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.314401:0:13717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.314438:0:13717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789129269.314444:0:13717:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789129269.314470:0:13717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789129269.314482:0:13717:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b4a7888780 x1876037626593152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789129278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129269.314500:0:13717:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789129269.314506:0:13717:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789129269.314512:0:13717:0:(import.c:65:import_set_state_nolock()) ffff90b4a7802800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789129269.314532:0:13717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789129269.314537:0:13717:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b4a7888780 x1876037626593152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789129278 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129269.314545:0:13717:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789129269.314548:0:13717:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00010000:00010000:1.0:1789129269.314914:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129269.314923:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.314954:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b489b87800 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129269.315031:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.315041:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789129269.315048:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129269.315053:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789129269.315055:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789129269.315058:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789129269.315072:0:5829:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b489c88800 00010000:00010000:1.0:1789129269.315076:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.315082:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b489b87800/0x5c74554e47ce4298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce429f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.315095:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129269.315096:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129269.315098:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129269.315364:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7888780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626593152:0@lo:38:kworker.0 00010000:00010000:2.0:1789129269.318418:0:13717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.318440:0:13717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.318448:0:13717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.318455:0:13717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.318992:0:13717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789129269.319002:0:13717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.319010:0:13717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.319017:0:13717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129269.319022:0:13717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.319345:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789129269.319354:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.319361:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031a00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129269.319365:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.319381:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789129269.319388:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129269.319393:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789129269.319396:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789129269.319407:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b489c88800 00010000:00010000:1.0:1789129269.319411:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.319417:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b480031a00/0x5c74554e47ce42a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce42ad expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.319431:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129269.319435:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.319440:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129269.319443:0:5828:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.319449:0:5828:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789129269.319455:0:5828:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129269.319471:0:5828:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789129269.319474:0:5828:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789129269.319479:0:5828:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b489c88800 00010000:00010000:1.0:1789129269.319482:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129269.319491:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129269.319493:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129269.319495:0:5828:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129269.319567:0:13717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789129269.319573:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b490362600/0x5c74554e47ce450e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce4515 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129269.319588:0:13717:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1789129269.319593:0:13717:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1789129269.319596:0:13717:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789129269.319665:0:13717:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789129269.319671:0:13717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789129269.319677:0:13717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789129269.319683:0:13717:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789129269.319688:0:13717:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90b4a785ced8) has no exports 00000020:00080000:2.0:1789129269.319923:0:13717:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90b4a785ced8) has no exports 00000020:01000000:2.0:1789129269.325599:0:13717:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b4885f41e0 - data ffff90b4bfe33e58/ffff90b4b58e7c00 00000020:01000000:2.0:1789129269.325863:0:13717:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90b492171300 - data ffff90b4a268a000/ffff90b381241c00 00010000:00010000:3.0:1789129269.326520:0:8443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789129269.338094:0:13717:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789129269.441743:0:13717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce418e 00000020:00000080:0.0:1789129269.441755:0:13717:0:(genops.c:885:class_export_put()) final put ffff90b4c0949000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789129269.441771:0:13717:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b3812fb000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789129269.441776:0:13717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b3812fb000 2 00000020:01000004:0.0:1789129269.441779:0:13717:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90b3812fb000 from lustre-OST0001 00000020:00000080:0.0:1789129269.441805:0:13717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789129269.441815:0:13717:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789129269.441818:0:13717:0:(genops.c:885:class_export_put()) final put ffff90b4c094e000/lustre-OST0001_UUID 00000020:00000080:0.0:1789129269.441821:0:13717:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c094e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789129269.441829:0:13717:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789129269.441931:0:13717:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4a927c41-01d5-424a-b17c-4bdb2d4e760d->MGS 00010000:00010000:0.0:1789129269.441950:0:13717:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b481657000/0x5c74554e47ce40a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce40a7 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129269.442103:0:13717:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b481657000/0x5c74554e47ce40a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce40a7 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129269.442110:0:13717:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789129269.442113:0:13717:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789129269.442116:0:13717:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00000020:00000080:1.0:1789129269.442294:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4c0949000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:0.0:1789129269.442342:0:13717:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b489c88800 00010000:00010000:0.0:1789129269.442347:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b481657000/0x5c74554e47ce40a0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce40a7 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129269.446175:0:13717:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b489b87600/0x5c74554e47ce42ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5c74554e47ce42f3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129269.446198:0:13717:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b489b87600/0x5c74554e47ce42ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5c74554e47ce42f3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129269.446296:0:13717:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789129269.446300:0:13717:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789129269.446303:0:13717:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789129269.446332:0:13717:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90b489c88800 00010000:00010000:0.0:1789129269.446336:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b489b87600/0x5c74554e47ce42ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5c74554e47ce42f3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789129269.446359:0:13717:0:(import.c:65:import_set_state_nolock()) ffff90b489c88800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789129269.446583:0:13717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789129269.446587:0:13717:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789129269.446589:0:13717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789129269.446594:0:13717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789129269.447126:0:13717:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90b383cada40 x1876037626593664/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789129275 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789129269.447191:0:13717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789129269.447195:0:13717:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00010000:00010000:1.0:1789129269.447525:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129269.447583:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4a927c41-01d5-424a-b17c-4bdb2d4e760d:3305:1876037626593664:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:1.0:1789129269.447969:0:13717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789129269.447992:0:13717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce3f81 00000020:00000080:1.0:1789129269.448002:0:13717:0:(genops.c:885:class_export_put()) final put ffff90b485c13800/4a927c41-01d5-424a-b17c-4bdb2d4e760d 00000020:01000000:1.0:1789129269.448024:0:13717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.139@tcp (flags='') 00000020:00000080:1.0:1789129269.448031:0:13717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789129269.448040:0:13717:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.139@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789129269.448044:0:13717:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff90b487c73490) has no exports 10000000:01000000:1.0:1789129269.448067:0:5837:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789129269.448142:0:13717:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.139@tcp: client import never connected 00000100:00080000:1.0:1789129269.448146:0:13717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789129269.448148:0:13717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789129269.448151:0:13717:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789129269.448153:0:13717:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789129269.448190:0:13717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789129269.448198:0:13717:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.139@tcp (uuid 4a927c41-01d5-424a-b17c-4bdb2d4e760d) 00000020:01000000:1.0:1789129269.448205:0:13717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789129269.448208:0:13717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789129269.448213:0:13717:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789129269.448218:0:13717:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90b4a7806800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789129269.448249:0:13717:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff90b3824e0000) has exports, disconnecting them 00000020:00080000:1.0:1789129269.448254:0:13717:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90b4a7806800), last request at 1789129023 00000020:00000080:1.0:1789129269.448259:0:13717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce41b8 00000020:00080000:1.0:1789129269.448271:0:13717:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90b4a7806800): rc 0 00000020:00000080:1.0:1789129269.448275:0:13717:0:(genops.c:885:class_export_put()) final put ffff90b4a7806800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789129269.448468:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b485c13800/4a927c41-01d5-424a-b17c-4bdb2d4e760d for MGC192.168.201.139@tcp 00000020:00000080:0.0:1789129269.448477:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7806800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789129269.454186:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b489c88800 for MGC192.168.201.139@tcp 00000020:00000080:0.0:1789129269.454207:0:36:0:(genops.c:885:class_export_put()) final put ffff90b489c8e800/4a927c41-01d5-424a-b17c-4bdb2d4e760d 00000020:00000080:0.0:1789129269.454214:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b489c8e800/4a927c41-01d5-424a-b17c-4bdb2d4e760d for MGC192.168.201.139@tcp 00000020:01000000:0.0:1789129269.454224:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.139@tcp (4a927c41-01d5-424a-b17c-4bdb2d4e760d) 00010000:01000000:0.0:1789129269.457938:0:13717:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789129269.457951:0:13717:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789129269.457963:0:13717:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789129269.457972:0:13717:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789129269.458144:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90b4a7802800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789129269.459672:0:5828:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789129269.460148:0:8443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789129269.460289:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789129269.460498:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90b48607f400:5824] 1 exiting: rc = 0 00000100:00100000:0.0:1789129269.461943:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90b492121200:5823] 0 exiting: rc = 1 00000100:00100000:3.0:1789129269.462155:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.462496:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90b4a2a26c00:5827] 2 exiting: rc = 0 00000100:00100000:0.0:1789129269.462796:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90b492121c00:5826] 1 exiting: rc = 0 00000100:00100000:0.0:1789129269.463973:0:8444:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90b490360e00:8444] 3 exiting: rc = 0 00000100:00100000:0.0:1789129269.465795:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90b48607e800:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1789129269.465970:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.465990:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466000:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466008:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466015:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466021:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466028:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466033:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466038:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466045:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466050:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466059:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466065:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466070:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466077:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466084:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466090:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466097:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466102:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466108:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466113:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466119:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466140:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466147:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466153:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466159:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466165:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466171:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466177:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466183:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466188:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466193:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466198:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466218:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466225:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466230:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466235:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466240:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466256:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466262:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466267:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466271:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466276:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466280:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466286:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466291:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466297:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466302:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466307:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466312:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466318:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466323:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466330:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466335:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466342:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466348:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466354:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466377:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466384:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466390:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466396:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466402:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466407:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.466412:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789129269.467896:0:13717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129269.467910:0:13717:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789129269.467917:0:13717:0:(genops.c:885:class_export_put()) final put ffff90b4a7801000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789129269.467921:0:13717:0:(genops.c:844:class_export_destroy()) destroying export ffff90b4a7801000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789129269.467941:0:13717:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789129269.468008:0:13717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b3812fb000 1 00000020:00000080:3.0:1789129269.468015:0:13717:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5c74554e47ce415d 00000020:00000080:3.0:1789129269.468022:0:13717:0:(genops.c:885:class_export_put()) final put ffff90b48647f800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789129269.468079:0:13717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789129269.468086:0:13717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789129269.468091:0:13717:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789129269.468095:0:13717:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff90b4bb021a48) has no exports 00000020:00000080:0.0:1789129269.471939:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90b48647f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789129269.490940:0:13717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129269.490967:0:13717:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789129269.490974:0:13717:0:(genops.c:885:class_export_put()) final put ffff90b3812fc800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789129269.490989:0:13717:0:(genops.c:844:class_export_destroy()) destroying export ffff90b3812fc800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789129269.491001:0:13717:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789129269.491252:0:13717:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90b3812f8000 00000020:01000000:3.0:1789129269.491278:0:13717:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789129269.491282:0:13717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789129269.491287:0:13717:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789129269.491291:0:13717:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff90b487c70000) has no exports 00000020:00000080:3.0:1789129269.491326:0:13717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789129269.491332:0:13717:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789129269.491337:0:13717:0:(genops.c:885:class_export_put()) final put ffff90b488b59800/OSS_uuid 00000020:00000080:3.0:1789129269.491339:0:13717:0:(genops.c:844:class_export_destroy()) destroying export ffff90b488b59800/OSS_uuid for OSS 00000020:01000000:3.0:1789129269.491357:0:13717:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789129269.491520:0:5836:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789129269.491743:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90b4c1973200:6689] 2 exiting: rc = 0 00000100:00100000:3.0:1789129269.491795:0:12455:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff90b4a78a6000:12455] 3 exiting: rc = 0 00000100:00100000:3.0:1789129269.491840:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90b4bab1f400:6686] 0 exiting: rc = 1 00000100:00100000:3.0:1789129269.491881:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff90b4c0951800:6688] 1 exiting: rc = 0 00000100:00100000:3.0:1789129269.491932:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.491939:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.491945:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492076:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492086:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492091:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492096:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492103:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492108:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492115:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492120:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492125:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492130:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492136:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492140:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492146:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492150:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492156:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492161:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492166:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492172:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492178:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492183:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492188:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492195:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492201:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492206:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492212:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492227:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492233:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492238:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492243:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492250:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492255:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492261:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492267:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492273:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492277:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492282:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492287:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492292:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492298:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492303:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492309:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492314:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492320:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492325:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492330:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492336:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492341:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492346:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492352:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492358:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492523:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492532:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492538:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492544:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492550:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492555:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492562:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492568:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492573:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492579:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.492594:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.501487:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90b4bae1d400:6690] 0 exiting: rc = 1 00000100:00100000:3.0:1789129269.505844:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90b4c1973c00:6691] 1 exiting: rc = 0 00000100:00100000:3.0:1789129269.506016:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506026:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506032:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506038:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506044:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506049:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506057:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506062:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506068:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506073:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506078:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506083:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506088:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506093:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506099:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506105:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506110:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506115:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506120:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506125:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506130:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506135:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506141:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506146:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506151:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506157:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506162:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506166:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506171:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506176:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506180:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506186:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506191:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506216:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506221:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506352:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506370:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506379:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506385:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506391:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506397:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506402:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506409:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506415:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506421:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506428:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506435:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506440:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506446:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506451:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506456:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506461:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506468:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506474:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506484:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506491:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506498:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506503:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506509:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506515:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506520:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506527:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506534:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.506539:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.512853:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90b4bab53e00:6694] 2 exiting: rc = 0 00000100:00100000:3.0:1789129269.514122:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90b4bab52e00:6693] 1 exiting: rc = 0 00000100:00100000:3.0:1789129269.514921:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90b4bab52000:6692] 0 exiting: rc = 1 00000100:00100000:0.0:1789129269.515069:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515078:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515084:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515090:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515096:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515101:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515106:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515112:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515135:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515141:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515147:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515153:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515158:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515164:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515170:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515175:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515181:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515187:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515192:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515197:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515202:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515208:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515213:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515218:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515250:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515256:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515261:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515267:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515272:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515277:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515283:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515289:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515306:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515312:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515318:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515323:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515329:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515334:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515339:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515344:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515350:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515356:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515361:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515376:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515381:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515387:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515393:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515398:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515404:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515409:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515415:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515420:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515425:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515430:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515436:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515441:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515459:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515465:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515471:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515482:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515488:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515493:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515500:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.515506:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789129269.528152:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90b4a7a46a00:6696] 1 exiting: rc = 0 00000100:00100000:0.0:1789129269.528407:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90b4a7a46200:6695] 0 exiting: rc = 1 00000100:00100000:0.0:1789129269.528479:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528488:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528494:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528500:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528506:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528513:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528518:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528524:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528529:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528535:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528541:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528547:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528553:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528560:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528566:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528572:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528578:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528584:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528590:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528597:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528630:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528636:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528889:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528896:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528902:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528909:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528914:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528919:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.528934:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529094:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529101:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529107:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529112:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529117:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529122:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529128:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529134:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529140:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529145:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529151:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529157:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529161:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529166:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529171:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529177:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529182:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529187:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529192:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529198:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529204:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529212:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529218:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529223:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529240:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529246:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529251:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529257:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529262:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529268:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529273:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529277:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529283:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529288:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.529294:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789129269.531290:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90b4a2a29200:6698] 1 exiting: rc = 0 00000100:00100000:3.0:1789129269.531593:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90b4b7765400:6697] 0 exiting: rc = 1 00000100:00100000:0.0:1789129269.531923:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.531943:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.531950:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.531962:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.531970:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.531988:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.531995:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532001:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532006:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532012:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532018:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532023:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532043:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532049:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532055:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532061:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532067:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532072:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532078:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532085:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532092:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532098:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532103:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532109:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532128:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532135:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532141:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532147:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532153:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532160:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532168:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532176:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532182:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532188:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532193:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532207:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532224:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532242:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532248:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532259:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532267:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532275:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532282:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532290:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532296:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532302:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532309:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532315:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532335:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532343:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532349:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532356:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532371:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532378:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532386:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532393:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532400:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532406:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532412:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532420:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532426:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532434:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532440:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789129269.532446:0:13717:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789129269.556122:0:13717:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789129291.504084:0:14337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789129303.895028:0:14798:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789129303.895033:0:14798:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789129303.895142:0:14798:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90b49bdce800 00000020:01000004:3.0:1789129303.895164:0:14798:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789129303.895175:0:14798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789129303.895193:0:14798:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90b3824e0000) 00000020:00000080:3.0:1789129303.895209:0:14798:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789129303.955075:0:14798:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789129303.961564:0:14798:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789129303.962005:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 475: rc = 0 00100000:10000000:1.0:1789129303.962197:0:14798:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789129303.962265:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 475: rc = 0 00100000:10000000:1.0:1789129303.962375:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 475: rc = 0 00100000:10000000:1.0:1789129303.962476:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 475: rc = 0 00100000:10000000:1.0:1789129303.962572:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 475: rc = 0 00100000:10000000:1.0:1789129303.962705:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 475: rc = 0 00100000:10000000:1.0:1789129303.962982:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 477: rc = 0 00100000:10000000:1.0:1789129303.965995:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 564: rc = 0 00100000:10000000:1.0:1789129303.966111:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 564: rc = 0 00100000:10000000:1.0:1789129303.966577:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 178: rc = 0 00100000:10000000:1.0:1789129303.967507:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1789129303.967804:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1789129303.968070:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 178: rc = 0 00100000:10000000:1.0:1789129303.968302:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 178: rc = 0 00100000:10000000:1.0:1789129303.969779:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1789129303.970063:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 178: rc = 0 00100000:10000000:1.0:1789129303.970755:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1789129303.971028:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 178: rc = 0 00100000:10000000:1.0:1789129303.973068:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 178: rc = 0 00100000:10000000:1.0:1789129303.973416:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1789129303.973706:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 178: rc = 0 00100000:10000000:1.0:1789129303.974129:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 752: rc = 0 00100000:10000000:1.0:1789129303.979505:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 752: rc = 0 00100000:10000000:1.0:1789129303.980007:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 752: rc = 0 00100000:10000000:1.0:1789129303.981592:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 752: rc = 0 00100000:10000000:2.0:1789129303.983659:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 752: rc = 0 00100000:10000000:2.0:1789129303.983930:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 752: rc = 0 00100000:10000000:2.0:1789129303.984179:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 752: rc = 0 00100000:10000000:2.0:1789129303.984451:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 752: rc = 0 00100000:10000000:2.0:1789129303.984762:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 752: rc = 0 00100000:10000000:2.0:1789129303.985034:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 752: rc = 0 00100000:10000000:2.0:1789129303.985280:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 752: rc = 0 00100000:10000000:2.0:1789129303.985569:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 752: rc = 0 00100000:10000000:2.0:1789129303.985866:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 752: rc = 0 00100000:10000000:2.0:1789129303.986111:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 752: rc = 0 00100000:10000000:2.0:1789129303.996149:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 752: rc = 0 00100000:10000000:2.0:1789129303.996717:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 752: rc = 0 00100000:10000000:2.0:1789129303.996913:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 752: rc = 0 00100000:10000000:2.0:1789129304.001111:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 752: rc = 0 00100000:10000000:2.0:1789129304.001680:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 752: rc = 0 00100000:10000000:2.0:1789129304.001956:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 752: rc = 0 00100000:10000000:2.0:1789129304.002438:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 752: rc = 0 00100000:10000000:2.0:1789129304.002684:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 752: rc = 0 00100000:10000000:2.0:1789129304.002866:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 752: rc = 0 00100000:10000000:2.0:1789129304.008650:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 752: rc = 0 00100000:10000000:2.0:1789129304.008981:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 752: rc = 0 00100000:10000000:2.0:1789129304.010509:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 752: rc = 0 00100000:10000000:2.0:1789129304.010784:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 752: rc = 0 00100000:10000000:2.0:1789129304.015394:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 752: rc = 0 00100000:10000000:2.0:1789129304.017700:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 752: rc = 0 00100000:10000000:2.0:1789129304.019972:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 752: rc = 0 00100000:10000000:2.0:1789129304.020577:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 752: rc = 0 00100000:10000000:2.0:1789129304.020895:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 752: rc = 0 00100000:10000000:2.0:1789129304.021517:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 192: rc = 0 00100000:10000000:2.0:1789129304.028242:0:14798:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789129304.028517:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 565: rc = 0 00100000:10000000:2.0:1789129304.028785:0:14798:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789129304.028853:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 565: rc = 0 00100000:10000000:2.0:1789129304.029942:0:14798:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789129304.031006:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 565: rc = 0 00100000:10000000:2.0:1789129304.031538:0:14798:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789129304.031663:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 176: rc = 0 00100000:10000000:2.0:1789129304.031869:0:14798:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789129304.031944:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 176: rc = 0 00100000:10000000:2.0:1789129304.032144:0:14798:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789129304.032216:0:14798:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 176: rc = 0 00000020:00000080:2.0:1789129304.032515:0:14798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789129304.032525:0:14798:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789129304.032537:0:14798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce52c1 00000020:01000004:2.0:1789129304.032545:0:14798:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789129304.032552:0:14798:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789129304.032558:0:14798:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90b49bdce800 from MGS 00000020:01000004:2.0:1789129304.032563:0:14798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789129304.032575:0:14798:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90b4b5763490) 00000020:00000080:2.0:1789129304.032586:0:14798:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789129304.032674:0:14798:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b49bdce800 from MGS, refs=2 00080000:01000000:2.0:1789129304.032679:0:14798:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789129304.032684:0:14798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce52cf 00000100:00100000:2.0:1789129304.032775:0:14798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789129304.032919:0:14798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789129304.032925:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789129304.034389:0:14798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789129304.034400:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789129304.035089:0:14798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789129304.035268:0:14798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789129304.035273:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789129304.036874:0:14798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789129304.036890:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789129304.037744:0:14798:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789129304.037825:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789129304.038902:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129304.038907:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129304.038909:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129304.039283:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129304.039286:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129304.039288:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129304.050349:0:14798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789129304.054433:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789129304.085488:0:14798:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789129304.085524:0:14798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789129304.085528:0:14798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789129304.097492:0:14807:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789129304.097776:0:14798:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789129304.097893:0:14798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789129304.098400:0:14798:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789129304.098744:0:14798:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789129304.098961:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789129304.098970:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789129304.106406:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789129304.106436:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789129304.109038:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789129304.109055:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789129304.109944:0:14798:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789129304.109971:0:14798:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.139@tcp' 00000020:01000004:2.0:1789129304.109973:0:14798:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789129304.110005:0:14798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.139@tcp (typ=mgc) 00000020:00000080:2.0:1789129304.110020:0:14798:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.139@tcp (ffff90b4b5764ed8) 00000020:00000080:2.0:1789129304.110045:0:14798:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789129304.110196:0:14798:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b485cb1800@MGC192.168.201.139@tcp: add connection 192.168.201.139@tcp at head 00010000:00010000:2.0:1789129304.110389:0:14798:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.139@tcp-0 is initialized 00000040:01000000:2.0:1789129304.110397:0:14798:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789129304.110943:0:14812:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789129304.116780:0:14813:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789129304.116923:0:14798:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.139@tcp (uuid 3bfd76cf-bae1-432b-b8fe-46974cf010df) 00000020:00000080:0.0:1789129304.116960:0:14798:0:(genops.c:1385:class_connect()) connect: client 3bfd76cf-bae1-432b-b8fe-46974cf010df, cookie 0x5c74554e47ce52dd 00000100:00080000:0.0:1789129304.116981:0:14798:0:(import.c:510:import_select_connection()) MGC192.168.201.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789129304.116988:0:14798:0:(import.c:624:import_select_connection()) MGC192.168.201.139@tcp: import ffff90b485cb1800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789129304.117024:0:14798:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b383caed00 x1876037626593792/t0(0) o250->MGC192.168.201.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789129304.117059:0:14798:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3bfd76cf-bae1-432b-b8fe-46974cf010df->MGS 00000020:01000004:0.0:1789129304.117087:0:14798:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789129304.117092:0:14798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789129304.117110:0:14798:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90b4a785ced8) 00000020:00000080:0.0:1789129304.117123:0:14798:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789129304.120765:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3bfd76cf-bae1-432b-b8fe-46974cf010df:3305:1876037626593792:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789129304.120869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129304.120965:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626593792 00000100:00100000:1.0:1789129304.120974:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626593792 00000100:00100000:1.0:1789129304.121012:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789129304.121021:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1876037626593792:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789129304.121048:0:14809:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 3bfd76cf-bae1-432b-b8fe-46974cf010df@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:1.0:1789129304.121086:0:14809:0:(genops.c:1385:class_connect()) connect: client 3bfd76cf-bae1-432b-b8fe-46974cf010df, cookie 0x5c74554e47ce52eb 00000100:00080000:1.0:1789129304.121263:0:14809:0:(import.c:65:import_set_state_nolock()) ffff90b3810d6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789129304.121319:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+5:3305:x1876037626593792:12345-0@lo:250:mount.lustre.0 Request processed in 298us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129304.121328:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789129304.121471:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789129304.121480:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.139@tcp: connect to target with instance 0 00000100:00080000:1.0:1789129304.121489:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789129304.121494:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789129304.121498:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485cb1800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789129304.121500:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789129304.121510:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789129304.121516:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3bfd76cf-bae1-432b-b8fe-46974cf010df:3305:1876037626593792:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789129304.139712:0:14798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789129304.139971:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789129304.139978:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789129304.142900:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789129304.142914:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789129304.143432:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789129304.143441:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789129304.144240:0:14798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789129304.144486:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789129304.144493:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789129304.158332:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789129304.158356:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789129304.312119:0:14798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789129304.312421:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789129304.312431:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789129304.314927:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789129304.314943:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789129304.315884:0:14798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789129304.316097:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789129304.316102:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789129304.316837:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789129304.316846:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789129304.332022:0:14798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789129304.332260:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789129304.332267:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789129304.335946:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789129304.335972:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789129304.337051:0:14798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789129304.337239:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789129304.337245:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789129304.339784:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789129304.339804:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789129304.401562:0:14798:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789129304.401786:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789129304.401792:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789129304.415118:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789129304.415141:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789129304.421995:0:14798:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789129304.422013:0:14798:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789129304.425899:0:14798:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789129304.425932:0:14798:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789129304.425947:0:14798:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789129304.426123:0:14798:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789129304.426168:0:14798:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.139@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789129304.426174:0:14798:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789129304.426176:0:14798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789129304.426177:0:14798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129304.426179:0:14798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129304.426180:0:14798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129304.426181:0:14798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129304.426183:0:14798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789129304.426184:0:14798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789129304.426187:0:14798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129304.426188:0:14798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789129304.426191:0:14798:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789129304.426193:0:14798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789129304.426195:0:14798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789129304.426196:0:14798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129304.426197:0:14798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129304.426198:0:14798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129304.426199:0:14798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129304.426200:0:14798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789129304.426201:0:14798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789129304.426203:0:14798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129304.426204:0:14798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789129304.426238:0:14798:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789129304.426277:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626593920:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789129304.426405:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.426472:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4867be900 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.426735:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626593920 00000100:00100000:2.0:1789129304.426744:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626593920 00000100:00100000:2.0:1789129304.426804:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789129304.426815:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+5:14798:x1876037626593920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789129304.426873:0:14811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789129304.426877:0:14811:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789129304.426880:0:14811:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789129304.427686:0:14832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789129304.428069:0:14811:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789129304.430152:0:14833:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789129304.430164:0:14833:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789129304.430167:0:14833:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789129304.430200:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789129304.430780:0:14811:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789129304.430792:0:14811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789129304.439125:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+5:14798:x1876037626593920:12345-0@lo:253:mount.lustre.0 Request processed in 12301us (12710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129304.439141:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789129304.439250:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626593920:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789129304.439265:0:14798:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789129304.439269:0:14798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789129304.439270:0:14798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789129304.439281:0:14798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129304.439283:0:14798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129304.439284:0:14798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129304.439285:0:14798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129304.439287:0:14798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789129304.439288:0:14798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789129304.439290:0:14798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129304.439291:0:14798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789129304.439324:0:14798:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90b49bdce800 from lustre-MDT0000 10000000:01000000:3.0:1789129304.439364:0:14798:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789129304.439367:0:14798:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789129304.439372:0:14798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90b4b5764ed8 10000000:01000000:3.0:1789129304.439376:0:14798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789129304.439393:0:14798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90b4b5764ed8 from 1 10000000:01000000:3.0:1789129304.439396:0:14798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789129304.439449:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.439463:0:14798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.439473:0:14798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129304.439500:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789129304.439549:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.439728:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4867be000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129304.440209:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626594048 00000100:00100000:0.0:1789129304.440220:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626594048 00000100:00100000:0.0:1789129304.440317:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789129304.440328:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+5:14798:x1876037626594048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789129304.440344:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129304.440696:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b490363a00/0x5c74554e47ce52f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce52f2 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.440733:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490363a00/0x5c74554e47ce52f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce52f2 expref: 6 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.440746:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b490363a00/0x5c74554e47ce52f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce52f2 expref: 6 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.440756:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363a00, rc 0) 00000100:00100000:0.0:1789129304.440838:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+6:14798:x1876037626594048:12345-0@lo:101:mount.lustre.0 Request processed in 512us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129304.440845:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789129304.440974:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789129304.440994:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce52f9 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.441004:0:14798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce52f9 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129304.441107:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789129304.441151:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.441327:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4867be000 going to sleep for 11 seconds 00000100:00100000:1.0:1789129304.441712:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626594176 00000100:00100000:1.0:1789129304.441719:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626594176 00000100:00100000:1.0:1789129304.441752:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789129304.441759:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+6:14798:x1876037626594176:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789129304.442027:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+6:14798:x1876037626594176:12345-0@lo:501:mount.lustre.0 Request processed in 268us (876us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789129304.442035:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789129304.442142:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594176:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789129304.442171:0:14798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789129304.442185:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce52f9 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.442194:0:14798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce52f9 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129304.442205:0:14798:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b49bdce800 10000000:01000000:3.0:1789129304.442210:0:14798:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789129304.442215:0:14798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90b49bdce800 10000000:01000000:3.0:1789129304.442217:0:14798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789129304.442220:0:14798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90b49bdce800 from 1 10000000:01000000:3.0:1789129304.442222:0:14798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789129304.442244:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce5300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.442251:0:14798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce5300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.442258:0:14798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce5300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129304.442271:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789129304.442431:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.442464:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4867be000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129304.442628:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626594304 00000100:00100000:0.0:1789129304.442633:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626594304 00000100:00100000:0.0:1789129304.442659:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789129304.442666:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+6:14798:x1876037626594304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789129304.442676:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129304.442689:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b490362800/0x5c74554e47ce5307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce5300 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.442707:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490362800/0x5c74554e47ce5307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce5300 expref: 7 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.442716:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b490362800/0x5c74554e47ce5307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce5300 expref: 7 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.442730:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362800, rc 0) 00000100:00100000:0.0:1789129304.442761:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+7:14798:x1876037626594304:12345-0@lo:101:mount.lustre.0 Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129304.442767:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789129304.442851:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789129304.442862:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce5300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5307 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.442871:0:14798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce5300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce5307 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129304.442883:0:14798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789129304.442887:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce5300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5307 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.442893:0:14798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf3a00/0x5c74554e47ce5300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5307 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129304.442899:0:14798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789129304.442902:0:14798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789129304.442908:0:14798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90b49bdce800 10000000:01000000:3.0:1789129304.442911:0:14798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789129304.442914:0:14798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789129304.442916:0:14798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789129304.442932:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3800/0x5c74554e47ce530e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.442939:0:14798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf3800/0x5c74554e47ce530e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.442947:0:14798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf3800/0x5c74554e47ce530e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129304.442965:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789129304.442992:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.443021:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4867be000 going to sleep for 11 seconds 00000100:00100000:1.0:1789129304.443091:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626594432 00000100:00100000:1.0:1789129304.443095:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626594432 00000100:00100000:1.0:1789129304.443114:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789129304.443120:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+7:14798:x1876037626594432:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789129304.443128:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129304.443138:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4b58db000/0x5c74554e47ce5315 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce530e expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129304.443151:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4b58db000/0x5c74554e47ce5315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce530e expref: 8 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129304.443159:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4b58db000/0x5c74554e47ce5315 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce530e expref: 8 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129304.443178:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58db000, rc 0) 00000100:00100000:1.0:1789129304.443210:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+8:14798:x1876037626594432:12345-0@lo:101:mount.lustre.0 Request processed in 90us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129304.443216:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789129304.443275:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789129304.443284:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf3800/0x5c74554e47ce530e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5315 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.443292:0:14798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf3800/0x5c74554e47ce530e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce5315 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129304.443490:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789129304.444103:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.444166:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4867be000 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.444221:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626594560 00000100:00100000:2.0:1789129304.444226:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626594560 00000100:00100000:1.0:1789129304.444280:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789129304.444289:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+8:14798:x1876037626594560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789129304.445042:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+9:14798:x1876037626594560:12345-0@lo:501:mount.lustre.0 Request processed in 751us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129304.445053:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789129304.445230:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789129304.450899:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789129304.451010:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129304.451095:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44240 going to sleep for 11 seconds 00000100:00100000:1.0:1789129304.451147:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626594688 00000100:00100000:1.0:1789129304.451155:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626594688 00000100:00100000:1.0:1789129304.451243:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789129304.451253:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+9:14798:x1876037626594688:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789129304.452151:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+9:14798:x1876037626594688:12345-0@lo:503:mount.lustre.0 Request processed in 895us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129304.452163:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789129304.452471:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626594688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789129304.453030:0:14834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14834:1876037626594816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129304.453100:0:14834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.453153:0:14834:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4867bee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.453201:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626594816 00000100:00100000:2.0:1789129304.453222:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626594816 00000100:00100000:2.0:1789129304.453272:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789129304.453290:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+9:14834:x1876037626594816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129304.453934:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+9:14834:x1876037626594816:12345-0@lo:502:llog_process_th.0 Request processed in 643us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129304.453943:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789129304.454008:0:14834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14834:1876037626594816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129304.454040:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129304.454054:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129304.454056:0:14834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789129304.454064:0:14834:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789129304.454066:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789129304.454083:0:14834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90b4b5760000) 00000020:00000080:2.0:1789129304.454103:0:14834:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789129304.454108:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789129304.454193:0:14834:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789129304.454200:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce5323 00000020:00000080:2.0:1789129304.455065:0:14834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789129304.455073:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129304.455079:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129304.455081:0:14834:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789129304.455084:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129304.455088:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129304.455090:0:14834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789129304.455093:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789129304.455102:0:14834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90b4b5761a48) 00000020:00000080:2.0:1789129304.455115:0:14834:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789129304.455119:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789129304.455120:0:14834:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789129304.455124:0:14834:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789129304.455129:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789129304.455176:0:14834:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b49bdce800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789129304.455206:0:14834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90b4bb279a48) 00000020:00000080:2.0:1789129304.455215:0:14834:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789129304.455271:0:14834:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789129304.455277:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce5338 00000020:00000080:2.0:1789129304.455977:0:14834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789129304.455987:0:14834:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789129304.455993:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5c74554e47ce533f 00080000:01000000:2.0:1789129304.456000:0:14834:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789129304.456004:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce5346 00010000:00010000:2.0:1789129304.602225:0:14834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789129304.603837:0:14834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1789129304.605155:0:14834:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789129304.607574:0:14834:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90b4bb27b490) 00000020:00000080:2.0:1789129304.607632:0:14834:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789129304.607719:0:14834:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789129304.607725:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce5354 00000020:00000080:3.0:1789129304.611203:0:14834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789129304.634383:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5c74554e47ce535b 00000020:00000080:0.0:1789129304.635894:0:14834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789129304.635915:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789129304.635925:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.635927:0:14834:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789129304.635931:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789129304.635935:0:14834:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789129304.635936:0:14834:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789129304.635938:0:14834:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789129304.635940:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789129304.635942:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.635944:0:14834:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789129304.635955:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789129304.635962:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.635963:0:14834:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789129304.635968:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789129304.636019:0:14834:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789129304.636054:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789129304.636057:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.636058:0:14834:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789129304.636061:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789129304.636066:0:14834:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789129304.636069:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.636071:0:14834:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789129304.636074:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789129304.636082:0:14834:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:0.0:1789129304.636118:0:14834:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789129304.636131:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789129304.636152:0:14834:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90b4a7858000) 00000020:00000080:0.0:1789129304.636173:0:14834:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789129304.636180:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789129304.636244:0:14834:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789129304.636250:0:14834:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789129304.636256:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce5369 00010000:00080000:0.0:1789129304.636323:0:14834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b485d0d800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:0.0:1789129304.636577:0:14834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1789129304.637060:0:14834:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789129304.637102:0:14834:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789129304.638088:0:14834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789129304.638156:0:14834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789129304.638257:0:14834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789129304.645463:0:14838:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789129304.645482:0:14838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789129304.648639:0:14834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789129304.648660:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789129304.648701:0:14834:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789129304.648722:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce5370 00000100:00080000:0.0:1789129304.648733:0:14834:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789129304.648740:0:14834:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90b485d0d800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789129304.648780:0:14834:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b383cac000 x1876037626594944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789129304.648867:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626594944:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789129304.648924:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626594944 offset 0 length 520: 4 00000100:00080000:0.0:1789129304.649004:0:14834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789129304.649080:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789129304.649085:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.649087:0:14834:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789129304.649090:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789129304.649094:0:14834:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1789129304.649095:0:14834:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789129304.649097:0:14834:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789129304.649099:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789129304.649119:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.649120:0:14834:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789129304.649124:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789129304.649129:0:14834:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789129304.649132:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.649133:0:14834:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789129304.649136:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789129304.649141:0:14834:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.139@tcp to nid 0x20000c0a8c98b (192.168.201.139@tcp) 00000020:01000000:0.0:1789129304.649169:0:14834:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789129304.649171:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789129304.649187:0:14834:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90b4a7859a48) 00000020:00000080:0.0:1789129304.649200:0:14834:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789129304.649205:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789129304.649276:0:14834:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789129304.649283:0:14834:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789129304.649290:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5c74554e47ce537e 00010000:00080000:0.0:1789129304.649344:0:14834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b485d09000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:0.0:1789129304.649629:0:14834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789129304.649866:0:14834:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789129304.649891:0:14834:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789129304.650539:0:14834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789129304.650652:0:14834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789129304.650745:0:14834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789129304.663446:0:14840:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789129304.663460:0:14840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789129304.665548:0:14834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789129304.665563:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789129304.665888:0:14834:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789129304.665909:0:14834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce5385 00000100:00080000:2.0:1789129304.665919:0:14834:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789129304.665925:0:14834:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b485d09000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:2.0:1789129304.665984:0:14834:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4a7888000 x1876037626595072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789129304.666013:0:14834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789129304.666079:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129304.666084:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129304.666085:0:14834:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789129304.666090:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129304.666094:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129304.666095:0:14834:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789129304.666098:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789129304.666099:0:14834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789129304.666109:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129304.666112:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129304.666113:0:14834:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789129304.666116:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129304.666118:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129304.666120:0:14834:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789129304.666124:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789129304.666169:0:14834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14834:1876037626595200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129304.666269:0:14834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129304.666331:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626595200 00000100:00100000:2.0:1789129304.666339:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626595200 00000100:00100000:2.0:1789129304.666402:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789129304.666412:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+9:14834:x1876037626595200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129304.667077:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626595072:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789129304.667123:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626595072 offset 0 length 520: 4 00000100:00100000:2.0:1789129304.667616:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+9:14834:x1876037626595200:12345-0@lo:502:llog_process_th.0 Request processed in 1186us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129304.667629:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789129304.667687:0:14834:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44180 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.667712:0:14834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14834:1876037626595200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789129304.667747:0:14834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129304.667754:0:14834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129304.667757:0:14834:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789129304.667760:0:14834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789129304.667823:0:14798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789129304.667842:0:14798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789129304.667861:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf3800/0x5c74554e47ce530e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5315 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129304.667873:0:14798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf3800/0x5c74554e47ce530e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5315 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129304.667896:0:14798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b49bdce800 from 1 10000000:01000000:2.0:1789129304.667899:0:14798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789129304.667934:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129304.667942:0:14798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129304.669253:0:14798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129304.669280:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626595328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789129304.670482:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129304.670589:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bad44180 going to sleep for 11 seconds 00000100:00100000:1.0:1789129304.676507:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626595328 00000100:00100000:1.0:1789129304.676525:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626595328 00000100:00100000:1.0:1789129304.676618:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789129304.676629:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+9:14798:x1876037626595328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789129304.676664:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129304.676693:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4b58db600/0x5c74554e47ce5393 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce538c expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129304.676726:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4b58db600/0x5c74554e47ce5393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce538c expref: 10 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129304.676739:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4b58db600/0x5c74554e47ce5393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce538c expref: 10 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129304.676751:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58db600, rc 0) 00000100:00100000:1.0:1789129304.677148:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+10:14798:x1876037626595328:12345-0@lo:101:mount.lustre.0 Request processed in 520us (7198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129304.677156:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789129304.678537:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626595328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789129304.678569:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.678583:0:14798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129304.680099:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626595456:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789129304.680207:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129304.680528:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483f27300 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.680593:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626595456 00000100:00100000:2.0:1789129304.680668:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626595456 00000100:00100000:2.0:1789129304.681114:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789129304.681128:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+10:14798:x1876037626595456:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789129304.681154:0:14811:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789129304.681160:0:14811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789129304.681280:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+10:14798:x1876037626595456:12345-0@lo:256:mount.lustre.0 Request processed in 155us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129304.681289:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789129304.681403:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626595456:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789129304.682051:0:14798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789129304.682082:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.682101:0:14798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129304.682112:0:14798:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b49bdce800 from 1 10000000:01000000:0.0:1789129304.682115:0:14798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789129304.682164:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.682172:0:14798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.682182:0:14798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129304.682206:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626595584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789129304.682256:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129304.682983:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483f27300 going to sleep for 11 seconds 00000100:00100000:1.0:1789129304.683117:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626595584 00000100:00100000:1.0:1789129304.683126:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626595584 00000100:00100000:1.0:1789129304.683177:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789129304.683186:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+10:14798:x1876037626595584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789129304.683203:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129304.683407:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4b58dba00/0x5c74554e47ce53a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce539a expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129304.683444:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4b58dba00/0x5c74554e47ce53a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce539a expref: 11 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129304.683458:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4b58dba00/0x5c74554e47ce53a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce539a expref: 11 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129304.683470:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58dba00, rc 0) 00000100:00100000:1.0:1789129304.683557:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14798:x1876037626595584:12345-0@lo:101:mount.lustre.0 Request processed in 372us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129304.683564:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789129304.683710:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626595584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789129304.683786:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129304.683796:0:14798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129304.683871:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626595712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129304.683905:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129304.683927:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483f27300 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.684046:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626595712 00000100:00100000:2.0:1789129304.684051:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626595712 00000100:00100000:2.0:1789129304.684087:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789129304.684095:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14798:x1876037626595712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789129304.685177:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14798:x1876037626595712:12345-0@lo:501:mount.lustre.0 Request processed in 1078us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129304.685188:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789129304.685538:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626595712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129304.685624:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626595840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789129304.685682:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129304.685713:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483f27300 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.685816:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626595840 00000100:00100000:2.0:1789129304.685822:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626595840 00000100:00100000:2.0:1789129304.685860:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789129304.685870:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14798:x1876037626595840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789129304.687724:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14798:x1876037626595840:12345-0@lo:503:mount.lustre.0 Request processed in 1844us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129304.687741:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789129304.688493:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626595840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789129304.689989:0:14842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14842:1876037626595968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129304.690083:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129304.690130:0:14842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483f27b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129304.690543:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626595968 00000100:00100000:1.0:1789129304.690553:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626595968 00000100:00100000:1.0:1789129304.690629:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789129304.690639:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14842:x1876037626595968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129304.690988:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14842:x1876037626595968:12345-0@lo:502:llog_process_th.0 Request processed in 350us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129304.690997:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789129304.691237:0:14842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14842:1876037626595968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789129304.691274:0:14842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789129304.691286:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.691288:0:14842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789129304.691295:0:14842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b49bdce800 00000020:00000080:0.0:1789129304.691297:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789129304.691315:0:14842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789129304.691318:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.691320:0:14842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789129304.691330:0:14842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789129304.691332:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.691333:0:14842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789129304.691337:0:14842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b49bdce800 00000020:00000080:0.0:1789129304.691339:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789129304.691416:0:14842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789129304.691420:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.691421:0:14842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789129304.691423:0:14842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789129304.691425:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.691427:0:14842:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789129304.691430:0:14842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b49bdce800 00000020:00000080:0.0:1789129304.691433:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789129304.691450:0:14842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789129304.691453:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.691454:0:14842:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789129304.691457:0:14842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789129304.691460:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.691461:0:14842:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789129304.691464:0:14842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b49bdce800 00000020:00000080:0.0:1789129304.691466:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789129304.691519:0:14842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14842:1876037626596096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129304.691564:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129304.691632:0:14842:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483f27b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789129304.691771:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626596096 00000100:00100000:3.0:1789129304.691777:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626596096 00000100:00100000:3.0:1789129304.691809:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789129304.691817:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14842:x1876037626596096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789129304.692008:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14842:x1876037626596096:12345-0@lo:502:llog_process_th.0 Request processed in 191us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129304.692016:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789129304.693762:0:14842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14842:1876037626596096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789129304.693808:0:14842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789129304.693819:0:14842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129304.693821:0:14842:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789129304.693826:0:14842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789129304.701563:0:14798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789129304.701634:0:14798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789129304.701666:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.701681:0:14798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129304.701744:0:14798:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789129304.701747:0:14798:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b49bdce800 10000000:01000000:3.0:1789129304.701751:0:14798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b49bdce800 10000000:01000000:3.0:1789129304.701755:0:14798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789129304.701762:0:14798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b49bdce800 from 1 10000000:01000000:3.0:1789129304.701765:0:14798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789129304.701808:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2600/0x5c74554e47ce53a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.701818:0:14798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b488bf2600/0x5c74554e47ce53a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.701829:0:14798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b488bf2600/0x5c74554e47ce53a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129304.701877:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626596224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789129304.702123:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.702184:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4867be900 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.702241:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626596224 00000100:00100000:2.0:1789129304.702250:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626596224 00000100:00100000:2.0:1789129304.702317:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789129304.702329:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14798:x1876037626596224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789129304.702356:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129304.702377:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4926ea800/0x5c74554e47ce53af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce53a8 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129304.702413:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4926ea800/0x5c74554e47ce53af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce53a8 expref: 12 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129304.702428:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4926ea800/0x5c74554e47ce53af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce53a8 expref: 12 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129304.702439:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ea800, rc 0) 00000100:00100000:2.0:1789129304.702487:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14798:x1876037626596224:12345-0@lo:101:mount.lustre.0 Request processed in 160us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129304.702507:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789129304.705573:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626596224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789129304.705631:0:14798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b488bf2600/0x5c74554e47ce53a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53af expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.705646:0:14798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b488bf2600/0x5c74554e47ce53a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce53af expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129304.705738:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626596352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789129304.705805:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.705850:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4867be900 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.705915:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626596352 00000100:00100000:2.0:1789129304.705922:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626596352 00000100:00100000:2.0:1789129304.705979:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789129304.705990:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14798:x1876037626596352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789129304.712126:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14798:x1876037626596352:12345-0@lo:501:mount.lustre.0 Request processed in 6127us (6308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129304.712142:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789129304.712345:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626596352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129304.712430:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626596480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789129304.712490:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129304.712538:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483f27e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.712921:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626596480 00000100:00100000:2.0:1789129304.712928:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626596480 00000100:00100000:2.0:1789129304.713097:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789129304.713110:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14798:x1876037626596480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789129304.713365:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14798:x1876037626596480:12345-0@lo:503:mount.lustre.0 Request processed in 244us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129304.713373:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789129304.720211:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626596480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789129304.721020:0:14846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14846:1876037626596608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129304.721123:0:14846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129304.721177:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626596608 00000100:00100000:1.0:1789129304.721184:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626596608 00000100:00100000:1.0:1789129304.721237:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789129304.721248:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14846:x1876037626596608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789129304.721573:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14846:x1876037626596608:12345-0@lo:502:llog_process_th.0 Request processed in 326us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129304.721582:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789129304.721665:0:14846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789129304.721681:0:14846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14846:1876037626596608:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789129304.721745:0:14846:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789129304.721762:0:14846:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90b487cb0000) 00000020:00000080:1.0:1789129304.721788:0:14846:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789129304.721877:0:14846:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b49bdce800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789129304.721882:0:14846:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b49bdce800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789129304.721888:0:14846:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b49bdce800 4 00010000:00080000:1.0:1789129304.721922:0:14846:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b4b599d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.139@tcp at head 00010000:00010000:1.0:1789129304.723471:0:14846:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789129304.732932:0:14846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789129304.732977:0:14846:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789129304.732988:0:14846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5c74554e47ce53bd 00000100:00080000:0.0:1789129304.732999:0:14846:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789129304.733005:0:14846:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90b4b599d000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789129304.733043:0:14846:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b383caf840 x1876037626596736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789129304.733074:0:14846:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789129304.734118:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626596736:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789129304.735312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.735452:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626596736 00000100:00100000:3.0:1789129304.735461:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626596736 00000100:00100000:3.0:1789129304.735510:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789129304.735518:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876037626596736:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789129304.735614:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876037626596736:12345-0@lo:38:llog_process_th.0 Request processed in 80us (292us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789129304.735623:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789129304.735665:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789129304.735673:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4b599d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789129304.735678:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789129304.735689:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626596736:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789129304.747520:0:14846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cade00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14846:1876037626596864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789129304.747640:0:14846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129304.747693:0:14846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b483f27300 going to sleep for 11 seconds 00000100:00100000:2.0:1789129304.747862:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626596864 00000100:00100000:2.0:1789129304.747872:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626596864 00000100:00100000:2.0:1789129304.749259:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789129304.749282:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14846:x1876037626596864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789129304.749658:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14846:x1876037626596864:12345-0@lo:502:llog_process_th.0 Request processed in 385us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129304.749667:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789129304.757163:0:14846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cade00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bfd76cf-bae1-432b-b8fe-46974cf010df:14846:1876037626596864:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789129304.757244:0:14846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789129304.759267:0:14798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789129304.759303:0:14798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789129304.759328:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2600/0x5c74554e47ce53a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53af expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.759341:0:14798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf2600/0x5c74554e47ce53a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53af expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789129304.759423:0:14798:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789129304.759426:0:14798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789129304.759428:0:14798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129304.759429:0:14798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129304.759430:0:14798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129304.759431:0:14798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129304.759432:0:14798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789129304.759434:0:14798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789129304.759435:0:14798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129304.759436:0:14798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789129304.759441:0:14798:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789129304.759444:0:14798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789129304.759445:0:14798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789129304.759446:0:14798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129304.759447:0:14798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129304.759448:0:14798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129304.759449:0:14798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129304.759450:0:14798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789129304.759451:0:14798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789129304.759452:0:14798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129304.759453:0:14798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789129304.759484:0:14798:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789129304.759508:0:14798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626596992:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789129304.759589:0:14798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.759825:0:14798:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4867be900 going to sleep for 11 seconds 00000100:00100000:0.0:1789129304.760397:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626596992 00000100:00100000:0.0:1789129304.760407:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626596992 00000100:00100000:0.0:1789129304.760471:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789129304.760481:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14798:x1876037626596992:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789129304.760516:0:14810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789129304.760529:0:14810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789129304.859320:0:14810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789129304.859339:0:14810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789129304.859424:0:14832:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789129304.859431:0:14832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789129304.859468:0:14832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129304.859505:0:14832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4b58db600/0x5c74554e47ce5393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce538c expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129304.859515:0:14832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129304.859562:0:14832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4b58db600/0x5c74554e47ce5393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce538c expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129304.859588:0:14832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4b58db600/0x5c74554e47ce5393 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce538c expref: 12 pid: 14809 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129304.859635:0:14832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14832:1876037626597120:0@lo:104: 00000100:00100000:2.0:1789129304.859719:0:14832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129304.859794:0:14832:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bd7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789129304.859902:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626597120 00000100:00100000:1.0:1789129304.859914:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626597120 00000100:00100000:1.0:1789129304.859980:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789129304.859991:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+3:14832:x1876037626597120:12345-0@lo:104: 00010000:00010000:1.0:1789129304.860009:0:14799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129304.860078:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789129304.860085:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+3:14832:x1876037626597120:12345-0@lo:104: Request processed in 96us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129304.860095:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789129304.860253:0:14832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14832:1876037626597120:0@lo:104: 00010000:00010000:2.0:1789129304.860274:0:14832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860334:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129304.860358:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860366:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789129304.860370:0:14805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860379:0:14805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789129304.860387:0:14805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129304.860393:0:14805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789129304.860431:0:14805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860438:0:14805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789129304.860466:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860474:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4926eb600/0x5c74554e47ce538c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce5393 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860494:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129304.860496:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129304.860497:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129304.860519:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129304.860530:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bfd76cf-bae1-432b-b8fe-46974cf010df:3306:1876037626597248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789129304.860568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129304.860644:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626597248 00000100:00100000:3.0:1789129304.860654:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626597248 00010000:00010000:3.0:1789129304.860674:0:14801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4b58db600/0x5c74554e47ce5393 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce538c expref: 13 pid: 14809 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129304.860702:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789129304.860710:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+13:3306:x1876037626597248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129304.860723:0:14801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129304.860728:0:14801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4b58db600/0x5c74554e47ce5393 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce538c expref: 13 pid: 14809 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860746:0:14801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4b58db600/0x5c74554e47ce5393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce538c expref: 13 pid: 14809 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860759:0:14801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4b58db600/0x5c74554e47ce5393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce538c expref: 13 pid: 14809 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860773:0:14801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860780:0:14801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789129304.860795:0:14801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001365480s 00010000:00010000:3.0:1789129304.860799:0:14801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860805:0:14801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860811:0:14801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860828:0:14801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860833:0:14801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129304.860837:0:14801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860846:0:14801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860861:0:14801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.860869:0:14801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129304.860899:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:3306:x1876037626597248:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129304.860906:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789129304.860936:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bfd76cf-bae1-432b-b8fe-46974cf010df:3306:1876037626597248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129304.861150:0:14832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.861159:0:14832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129304.861165:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926ea400/0x5c74554e47ce53c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129304.869078:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14798:x1876037626596992:12345-0@lo:253:mount.lustre.0 Request processed in 108584us (109475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129304.869111:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789129304.869197:0:14798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:14798:1876037626596992:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789129304.869356:0:14798:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789129304.869361:0:14798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789129304.869362:0:14798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789129304.869364:0:14798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789129304.869366:0:14798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789129304.869367:0:14798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789129304.869369:0:14798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789129304.869370:0:14798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789129304.869372:0:14798:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789129304.869374:0:14798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789129304.869375:0:14798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789129304.869394:0:14798:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789129304.886453:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789129304.886653:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789129304.887200:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789129304.887453:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789129304.887821:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789129304.888431:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789129304.892789:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789129304.892997:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789129304.893310:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789129304.893673:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789129304.893978:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789129304.894141:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789129304.991053:0:14798:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789129304.991772:0:14798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789129304.994685:0:14858:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789129304.994828:0:14858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789129304.998500:0:14858:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789129304.998635:0:14858:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789129304.998641:0:14858:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1789129305.000500:0:14798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789129305.000668:0:14798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789129305.001068:0:14798:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789129305.001075:0:14798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789129305.001199:0:14798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1789129305.002571:0:14857:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789129305.002583:0:14857:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1789129305.004118:0:14798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789129305.005066:0:14798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789129305.009479:0:14798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789129305.012078:0:14798:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789129305.039985:0:14798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1789129305.102509:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789129305.149351:0:14798:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789129305.149396:0:14798:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb11201c67988 00100000:10000000:3.0:1789129305.149406:0:14798:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789129305.150443:0:14798:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789129305.150466:0:14798:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789129305.150485:0:14798:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789129305.150536:0:14798:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 10000000:01000000:2.0:1789129305.205779:0:14813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789129305.205789:0:14813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b49bdce800 from 6 10000000:01000000:2.0:1789129305.205794:0:14813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789129305.205859:0:14813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129305.205885:0:14813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129305.205898:0:14813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129305.205934:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626597376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789129305.206360:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129305.206508:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bd7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129305.206576:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626597376 00000100:00100000:3.0:1789129305.206584:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626597376 00000100:00100000:3.0:1789129305.206662:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789129305.206673:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14813:x1876037626597376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129305.206687:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129305.206702:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce53d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce53cb expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129305.206724:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce53d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce53cb expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129305.206735:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce53d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce53cb expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129305.206745:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2000, rc 0) 00000100:00100000:3.0:1789129305.206807:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14813:x1876037626597376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129305.206815:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789129305.206921:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626597376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129305.206940:0:14813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129305.206951:0:14813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129305.207098:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626597504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789129305.207138:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129305.207170:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7bd7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129305.207222:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626597504 00000100:00100000:3.0:1789129305.207226:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626597504 00000100:00100000:3.0:1789129305.207260:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789129305.207474:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14813:x1876037626597504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789129305.207495:0:14810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789129305.207513:0:14810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789129305.207516:0:14810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789129305.207650:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14813:x1876037626597504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 382us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129305.207658:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789129305.214484:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626597504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789129305.214578:0:14813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789129305.214592:0:14813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129305.214702:0:14813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789129305.799661:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789129306.118645:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789129306.825675:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789129307.141814:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129308.171023:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129309.189921:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789129309.975494:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789129309.975503:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789129309.975506:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789129309.975509:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789129309.975511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789129309.975515:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789129309.975583:0:8:0:(import.c:65:import_set_state_nolock()) ffff90b4b599d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789129309.975598:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90b4b599d000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789129309.975691:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129309.975708:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626597632:0@lo:400:kworker.0 00000100:00100000:0.0:1789129309.975835:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129309.975971:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b383cac3c0 x1876037626597760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789129309.976009:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626597760:0@lo:38:kworker.0 00000100:00100000:0.0:1789129309.976048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129309.976096:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626597760 00000100:00100000:0.0:1789129309.976106:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626597760 00000100:00100000:0.0:1789129309.976144:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789129309.976153:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383caf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876037626597760:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789129309.976190:0:14818:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:0.0:1789129309.976250:0:14818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5c74554e47ce53d9 00000004:00100000:0.0:1789129309.976284:0:14818:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789129309.976459:0:14818:0:(import.c:65:import_set_state_nolock()) ffff90b489cac800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789129309.976516:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383caf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876037626597760:12345-0@lo:38:kworker.0 Request processed in 361us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129309.976524:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789129309.976568:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b383cac3c0 x1876037626597760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789129319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789129309.976585:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789129309.976594:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789129309.976598:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789129309.976626:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4b599d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789129309.976634:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876037626597760:0@lo:38:kworker.0 00000100:00100000:2.0:1789129309.976761:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626597632 00000100:00100000:2.0:1789129309.976767:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626597632 00000100:00100000:2.0:1789129309.976812:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789129309.976820:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:3309:x1876037626597632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129309.976870:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:3309:x1876037626597632:12345-0@lo:400:kworker.0 Request processed in 51us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129309.976878:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789129309.976917:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626597632:0@lo:400:kworker.0 00010000:00010000:1.0:1789129310.213842:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129311.238066:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789129311.519867:0:15101:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789129312.262337:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129313.292946:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129314.055327:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789129304/real 1789129304] req@ffff90b4a7888000 x1876037626595072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789129314 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129314.055405:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90b4a7888000 x1876037626595072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789129314 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129314.055419:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789129304/real 1789129304] req@ffff90b383cac000 x1876037626594944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789129314 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129314.055433:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90b383cac000 x1876037626594944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789129314 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789129314.055464:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789129314.055496:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789129314.055502:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626595072:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789129314.055509:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d0d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789129314.055515:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789129314.055519:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626594944:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789129314.056034:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789129314.056040:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789129314.056044:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b485d0d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789129314.056050:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:3.0:1789129314.056058:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789129314.056066:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90b485d0d800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789129314.056092:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bacd3480 x1876037626598016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789129314.056110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789129314.056125:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789129314.056126:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789129314.056130:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00100000:2.0:1789129314.056319:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626597888:0@lo:400:kworker.0 00000100:00100000:2.0:1789129314.056414:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129314.056521:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626597888 00000100:00100000:2.0:1789129314.056532:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626597888 00000100:00100000:2.0:1789129314.056633:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789129314.056646:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:3309:x1876037626597888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129314.056708:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:3309:x1876037626597888:12345-0@lo:400:kworker.0 Request processed in 64us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129314.056717:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789129314.056775:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626597888:0@lo:400:kworker.0 00000100:00080000:3.0:1789129314.057321:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789129314.057328:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b485d09000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789129314.057363:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bacd1e00 x1876037626598144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789129314.057431:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789129314.057444:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626598272:0@lo:400:kworker.0 00000100:00100000:3.0:1789129314.057491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129314.057543:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626598272 00000100:00100000:3.0:1789129314.057548:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626598272 00000100:00100000:3.0:1789129314.057584:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789129314.057591:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626598272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129314.057654:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876037626598272:12345-0@lo:400:kworker.0 Request processed in 62us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129314.057662:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789129314.057693:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b4bacd2d00 x1876037626598272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129314.057705:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876037626598272:0@lo:400:kworker.0 00000100:00100000:0.0:1789129314.057864:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626598016:0@lo:8:kworker.0 00000400:00000100:0.0:1789129314.057901:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626598016 offset 0 length 520: 4 00000100:00100000:0.0:1789129314.057924:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626598144:0@lo:8:kworker.0 00000400:00000100:0.0:1789129314.057944:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876037626598144 offset 0 length 520: 4 00010000:00010000:1.0:1789129314.310001:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129315.333918:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789129316.042342:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789129316.358060:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789129316.492927:0:15253:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff61c2d580 20000000:00000080:1.0:1789129316.492955:0:15253:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b4a7e4b400 uarg=0000000000000000 20000000:01000000:1.0:1789129316.493007:0:15253:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789129316.493017:0:15253:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789129316.493024:0:15253:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789129316.494284:0:15254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1789129316.494490:0:15253:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789129316.509596:0:15253:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789129316.509684:0:15253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129316.509713:0:15253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4b58dba00/0x5c74554e47ce53a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce539a expref: 11 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129316.509722:0:15253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129316.509788:0:15253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4b58dba00/0x5c74554e47ce53a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce539a expref: 11 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129316.509821:0:15253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4b58dba00/0x5c74554e47ce53a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce539a expref: 11 pid: 14809 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129316.509842:0:15253:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15253:1876037626598400:0@lo:104: 00000100:00100000:1.0:1789129316.509933:0:15253:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129316.510012:0:15253:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5afae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789129316.510099:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626598400 00000100:00100000:0.0:1789129316.510110:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626598400 00000100:00100000:0.0:1789129316.510202:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789129316.510215:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bfd76cf-bae1-432b-b8fe-46974cf010df+3:15253:x1876037626598400:12345-0@lo:104: 00010000:00010000:0.0:1789129316.510236:0:14800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510351:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789129316.510360:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bfd76cf-bae1-432b-b8fe-46974cf010df+3:15253:x1876037626598400:12345-0@lo:104: Request processed in 146us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129316.510371:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789129316.510399:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129316.510406:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510413:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362e00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789129316.510418:0:14804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510429:0:14804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129316.510436:0:14804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129316.510442:0:14804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789129316.510491:0:14804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510499:0:14804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789129316.510526:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510533:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b490362e00/0x5c74554e47ce539a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce53a1 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510563:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129316.510566:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129316.510568:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129316.510583:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bfd76cf-bae1-432b-b8fe-46974cf010df:3307:1876037626598528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789129316.510664:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129316.510709:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626598528 00000100:00100000:0.0:1789129316.510714:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626598528 00010000:00010000:0.0:1789129316.510738:0:14801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4b58dba00/0x5c74554e47ce53a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce539a expref: 12 pid: 14809 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129316.510763:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789129316.510773:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383caed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:3307:x1876037626598528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789129316.510785:0:14801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129316.510792:0:14801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4b58dba00/0x5c74554e47ce53a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce539a expref: 12 pid: 14809 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510807:0:14801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4b58dba00/0x5c74554e47ce53a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce539a expref: 12 pid: 14809 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510826:0:14801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510834:0:14801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510848:0:14801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510856:0:14801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510869:0:14801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510875:0:14801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510880:0:14801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dbe00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129316.510885:0:14801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510893:0:14801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510903:0:14801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129316.510915:0:14801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129316.510945:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383caed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:3307:x1876037626598528:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129316.510952:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789129316.510995:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bfd76cf-bae1-432b-b8fe-46974cf010df:3307:1876037626598528:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129316.511261:0:15253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4b58dba00/0x5c74554e47ce53a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce539a expref: 11 pid: 14809 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129316.511274:0:15253:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15253:1876037626598400:0@lo:104: 00010000:00010000:3.0:1789129316.511300:0:15253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129316.511311:0:15253:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129316.511316:0:15253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129316.511321:0:15253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4b58dbe00/0x5c74554e47ce53e0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129317.385667:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789129318.086102:0:14813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789129318.086123:0:14813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b49bdce800 from 13 10000000:01000000:0.0:1789129318.086131:0:14813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789129318.086200:0:14813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129318.086215:0:14813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129318.086250:0:14813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129318.086288:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cac3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626598656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789129318.086380:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129318.086451:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789129318.086828:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626598656 00000100:00100000:3.0:1789129318.086839:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626598656 00000100:00100000:3.0:1789129318.086910:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789129318.091215:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+11:14813:x1876037626598656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129318.091258:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129318.091297:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf3200/0x5c74554e47ce53ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce53e7 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129318.091343:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf3200/0x5c74554e47ce53ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce53e7 expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129318.091357:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf3200/0x5c74554e47ce53ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce53e7 expref: 12 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129318.091368:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3200, rc 0) 00000100:00100000:3.0:1789129318.091516:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14813:x1876037626598656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4594us (5135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129318.091549:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789129318.091825:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cac3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626598656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789129318.091861:0:14813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129318.091874:0:14813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129318.092060:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626598784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129318.092123:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129318.092169:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5afa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129318.092193:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626598784 00000100:00100000:1.0:1789129318.092201:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626598784 00000100:00100000:1.0:1789129318.092255:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789129318.092265:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14813:x1876037626598784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129318.096889:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14813:x1876037626598784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4610us (4764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129318.096909:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789129318.097126:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae783c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626598784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789129318.097224:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626598912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129318.097290:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129318.097334:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b381a8a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789129318.098826:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626598912 00000100:00100000:2.0:1789129318.098846:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626598912 00000100:00100000:2.0:1789129318.098918:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789129318.098930:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14813:x1876037626598912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129318.099264:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:14813:x1876037626598912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 336us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129318.099273:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789129318.101520:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626598912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789129318.102470:0:15291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789129318.102786:0:14813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789129318.102814:0:14813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789129318.102828:0:14813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129318.102842:0:14813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129318.405825:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789129319.174473:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789129319.174484:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789129319.174487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789129319.174491:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789129319.174535:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626599040:0@lo:400:kworker.0 00000100:00100000:3.0:1789129319.174648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129319.175466:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626599040 00000100:00100000:1.0:1789129319.175479:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626599040 00000100:00100000:1.0:1789129319.175557:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789129319.175569:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:3308:x1876037626599040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129319.175830:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:3308:x1876037626599040:12345-0@lo:400:kworker.0 Request processed in 261us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129319.175839:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789129319.176886:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626599040:0@lo:400:kworker.0 00000100:00100000:3.0:1789129319.176915:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789129319.176928:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626599168:0@lo:400:kworker.0 00000100:00100000:3.0:1789129319.176983:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129319.177049:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626599168 00000100:00100000:3.0:1789129319.177055:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626599168 00000100:00100000:3.0:1789129319.177115:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789129319.177125:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626599168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129319.177178:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626599168:12345-0@lo:400:kworker.0 Request processed in 55us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129319.177186:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789129319.179436:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b4bacd3840 x1876037626599168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129319.179463:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626599168:0@lo:400:kworker.0 00010000:00010000:0.0:1789129319.430424:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129320.460204:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129321.477863:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129322.502956:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129323.532306:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789129323.616884:0:15502:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789129323.616905:0:15502:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789129323.617070:0:15502:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90b489cb4000 00000020:01000004:1.0:1789129323.617090:0:15502:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789129323.617107:0:15502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789129323.617124:0:15502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90b487cb1a48) 00000020:00000080:1.0:1789129323.617143:0:15502:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789129323.646223:0:15502:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789129323.646955:0:15502:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789129323.648655:0:15502:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789129323.649298:0:15502:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789129323.650129:0:15502:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789129323.650583:0:15502:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1789129323.651052:0:15502:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1789129323.651248:0:15502:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1789129323.652518:0:15502:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 174: rc = 0 00100000:10000000:0.0:1789129323.656251:0:15502:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 174: rc = 0 00100000:10000000:0.0:1789129323.656670:0:15502:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 174: rc = 0 00100000:10000000:0.0:1789129323.658894:0:15502:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 174: rc = 0 00100000:10000000:0.0:1789129323.663215:0:15502:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 174: rc = 0 00100000:10000000:0.0:1789129323.664908:0:15502:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 174: rc = 0 00000020:00000080:0.0:1789129323.665677:0:15502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789129323.665690:0:15502:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789129323.665700:0:15502:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5c74554e47ce53fc 00000020:01000004:0.0:1789129323.665709:0:15502:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789129323.665731:0:15502:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789129323.666236:0:15502:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789129323.666256:0:15502:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789129323.666263:0:15502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789129323.666281:0:15502:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90b4a785b490) 00000020:00000080:0.0:1789129323.666295:0:15502:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1789129323.669908:0:15502:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789129323.670174:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789129323.670180:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789129323.679356:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789129323.679453:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789129323.690038:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789129323.690059:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789129323.702242:0:15502:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789129323.705173:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789129323.705185:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789129323.707658:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789129323.707697:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789129323.756125:0:15502:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789129323.756647:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789129323.756656:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789129323.766552:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789129323.766572:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789129323.774683:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789129323.774707:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789129323.789739:0:15502:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789129323.793200:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789129323.793217:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789129323.796243:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789129323.796266:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789129323.995400:0:15502:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789129323.996541:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789129323.996554:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789129324.010479:0:15502:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789129324.010669:0:15502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789129324.012169:0:15502:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789129324.012203:0:15502:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789129324.012212:0:15502:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789129324.047570:0:15502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789129324.047673:0:15502:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.139@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789129324.047678:0:15502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789129324.047680:0:15502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789129324.047682:0:15502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129324.047684:0:15502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129324.047685:0:15502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129324.047687:0:15502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129324.047688:0:15502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789129324.047691:0:15502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129324.047692:0:15502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789129324.047696:0:15502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789129324.047698:0:15502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789129324.047700:0:15502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789129324.047701:0:15502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129324.047702:0:15502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129324.047703:0:15502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129324.047704:0:15502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129324.047705:0:15502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789129324.047706:0:15502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129324.047707:0:15502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789129324.047736:0:15502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789129324.047756:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789129324.047832:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129324.047882:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5759180 going to sleep for 11 seconds 00000100:00100000:0.0:1789129324.047954:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626599296 00000100:00100000:0.0:1789129324.047963:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626599296 00000100:00100000:0.0:1789129324.048029:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789129324.048047:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:15502:x1876037626599296:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789129324.048095:0:14810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789129324.048099:0:14810:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789129324.048102:0:14810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789129324.068218:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:15502:x1876037626599296:12345-0@lo:253:mount.lustre.0 Request processed in 20172us (20376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129324.068233:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789129324.068386:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599296:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789129324.068406:0:15502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789129324.068410:0:15502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789129324.068418:0:15502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789129324.068420:0:15502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789129324.068421:0:15502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789129324.068422:0:15502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789129324.068423:0:15502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789129324.068425:0:15502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789129324.068428:0:15502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789129324.068429:0:15502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789129324.068451:0:15502:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90b489cb4000 from lustre-OST0000 10000000:01000000:3.0:1789129324.068484:0:15502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789129324.068487:0:15502:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789129324.068494:0:15502:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90b4b5764ed8 local copy 00010000:00010000:3.0:1789129324.068507:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce52f9 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129324.070285:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7889a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789129324.070385:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129324.070477:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1789129324.070726:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626599424 00000100:00100000:0.0:1789129324.070737:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626599424 00000100:00100000:0.0:1789129324.070861:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789129324.070871:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:15502:x1876037626599424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129324.071092:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:15502:x1876037626599424:12345-0@lo:501:mount.lustre.0 Request processed in 221us (708us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789129324.071100:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789129324.071181:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7889a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599424:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789129324.071202:0:15502:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789129324.071374:0:15502:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789129324.071383:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce52f9 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.071394:0:15502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce52f9 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129324.071433:0:15502:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b489cb4000 10000000:01000000:2.0:1789129324.071438:0:15502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789129324.071443:0:15502:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90b4b5764ed8 10000000:01000000:2.0:1789129324.071445:0:15502:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789129324.071448:0:15502:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90b4b5764ed8 from 1 10000000:01000000:2.0:1789129324.071451:0:15502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789129324.071481:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eb800/0x5c74554e47ce540a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.071488:0:15502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4926eb800/0x5c74554e47ce540a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.071496:0:15502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4926eb800/0x5c74554e47ce540a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129324.071511:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7889a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789129324.071539:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129324.080281:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab780 going to sleep for 11 seconds 00000100:00100000:1.0:1789129324.080695:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626599552 00000100:00100000:1.0:1789129324.080708:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626599552 00000100:00100000:1.0:1789129324.080766:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789129324.080776:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+12:15502:x1876037626599552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789129324.080793:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129324.080814:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4b58da200/0x5c74554e47ce5411 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce540a expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129324.080840:0:14811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4b58da200/0x5c74554e47ce5411 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce540a expref: 13 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129324.080851:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4b58da200/0x5c74554e47ce5411 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce540a expref: 13 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129324.080874:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4b58da200, rc 0) 00000100:00100000:1.0:1789129324.080932:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+13:15502:x1876037626599552:12345-0@lo:101:mount.lustre.0 Request processed in 157us (9392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129324.080938:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789129324.081094:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7889a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789129324.081114:0:15502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4926eb800/0x5c74554e47ce540a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5411 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.081125:0:15502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4926eb800/0x5c74554e47ce540a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce5411 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129324.081151:0:15502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789129324.081182:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eb800/0x5c74554e47ce540a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5411 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.081202:0:15502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926eb800/0x5c74554e47ce540a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5411 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129324.081210:0:15502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789129324.081214:0:15502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789129324.081221:0:15502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789129324.081223:0:15502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789129324.081251:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea200/0x5c74554e47ce5418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.081259:0:15502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4926ea200/0x5c74554e47ce5418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.081267:0:15502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4926ea200/0x5c74554e47ce5418 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129324.081298:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7889a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789129324.081336:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129324.081358:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1789129324.085678:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626599680 00000100:00100000:0.0:1789129324.085701:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626599680 00000100:00100000:0.0:1789129324.085784:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789129324.085795:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+13:15502:x1876037626599680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789129324.085820:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129324.085852:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b490362000/0x5c74554e47ce541f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce5418 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129324.085894:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490362000/0x5c74554e47ce541f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce5418 expref: 14 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129324.085909:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b490362000/0x5c74554e47ce541f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce5418 expref: 14 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129324.085919:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362000, rc 0) 00000100:00100000:0.0:1789129324.086027:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+14:15502:x1876037626599680:12345-0@lo:101:mount.lustre.0 Request processed in 234us (4689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129324.086035:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789129324.086951:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7889a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789129324.086975:0:15502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4926ea200/0x5c74554e47ce5418 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce541f expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.086987:0:15502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4926ea200/0x5c74554e47ce5418 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce541f expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129324.088722:0:15502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789129324.095733:0:15502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789129324.098896:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789129324.098983:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789129324.099027:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789129324.099494:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789129324.099527:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789129324.099553:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789129324.099662:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789129324.099669:0:15502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789129324.099773:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7889a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789129324.101021:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129324.101073:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860abb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789129324.101142:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626599808 00000100:00100000:0.0:1789129324.101150:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626599808 00000100:00100000:0.0:1789129324.101207:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789129324.101217:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+14:15502:x1876037626599808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129324.101885:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+14:15502:x1876037626599808:12345-0@lo:501:mount.lustre.0 Request processed in 668us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129324.101894:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789129324.102119:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7889a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789129324.102171:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789129324.102214:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129324.102249:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c202480 going to sleep for 11 seconds 00000100:00100000:1.0:1789129324.102354:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626599936 00000100:00100000:1.0:1789129324.102364:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626599936 00000100:00100000:1.0:1789129324.102440:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789129324.102453:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+14:15502:x1876037626599936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789129324.102943:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+14:15502:x1876037626599936:12345-0@lo:503:mount.lustre.0 Request processed in 494us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129324.102951:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789129324.103133:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626599936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789129324.104214:0:15502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789129324.104363:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789129324.104491:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129324.104581:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c202480 going to sleep for 11 seconds 00000100:00100000:2.0:1789129324.104855:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626600064 00000100:00100000:2.0:1789129324.104862:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626600064 00000100:00100000:2.0:1789129324.104898:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789129324.104906:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+14:15502:x1876037626600064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789129324.105448:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+14:15502:x1876037626600064:12345-0@lo:502:mount.lustre.0 Request processed in 540us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129324.105456:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789129324.105508:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789129324.105956:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789129324.106026:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789129324.106063:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789129324.106117:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789129324.106155:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789129324.106207:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789129324.106255:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789129324.114122:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789129324.114172:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789129324.114254:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789129324.114314:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789129324.114365:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789129324.114421:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789129324.114516:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129324.114569:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5afa300 going to sleep for 11 seconds 00000100:00100000:0.0:1789129324.115104:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626600192 00000100:00100000:0.0:1789129324.115114:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626600192 00000100:00100000:0.0:1789129324.115171:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789129324.115182:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+14:15502:x1876037626600192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789129324.115507:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+14:15502:x1876037626600192:12345-0@lo:502:mount.lustre.0 Request processed in 323us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129324.115520:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789129324.115684:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789129324.115779:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789129324.115805:0:15502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789129324.117107:0:15516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789129324.117118:0:15516:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789129324.117126:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129324.117128:0:15516:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789129324.117133:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789129324.117149:0:15516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90b4bb27ced8) 00000020:00000080:2.0:1789129324.117169:0:15516:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789129324.117175:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789129324.117238:0:15516:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b489cb4000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789129324.117248:0:15516:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789129324.117274:0:15516:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5c74554e47ce542d 00010000:00010000:3.0:1789129324.143453:0:15516:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789129324.144230:0:15516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789129324.150579:0:15516:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1789129324.175233:0:15516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789129324.175262:0:15516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129324.175268:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129324.175270:0:15516:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789129324.175273:0:15516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789129324.175276:0:15516:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1789129324.175278:0:15516:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789129324.175279:0:15516:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789129324.175281:0:15516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789129324.175283:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129324.175285:0:15516:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789129324.175287:0:15516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789129324.175290:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129324.175292:0:15516:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789129324.175294:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789129324.175296:0:15516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789129324.175299:0:15516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129324.175302:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129324.175303:0:15516:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789129324.175305:0:15516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789129324.175307:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129324.175308:0:15516:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789129324.175311:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789129324.175347:0:15516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129324.175351:0:15516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129324.175352:0:15516:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789129324.175355:0:15516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789129324.180366:0:15502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789129324.180413:0:15502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789129324.180438:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea200/0x5c74554e47ce5418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce541f expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129324.180452:0:15502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926ea200/0x5c74554e47ce5418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce541f expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129324.180473:0:15502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b489cb4000 from 1 10000000:01000000:1.0:1789129324.180475:0:15502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789129324.180515:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129324.180523:0:15502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129324.180534:0:15502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129324.180558:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789129324.180645:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129324.180689:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5afa180 going to sleep for 11 seconds 00000100:00100000:2.0:1789129324.180985:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626600320 00000100:00100000:2.0:1789129324.180993:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626600320 00000100:00100000:2.0:1789129324.181058:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789129324.181068:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+14:15502:x1876037626600320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789129324.181082:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129324.181095:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4926ebe00/0x5c74554e47ce543b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce5434 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.181119:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4926ebe00/0x5c74554e47ce543b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce5434 expref: 15 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.181130:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4926ebe00/0x5c74554e47ce543b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce5434 expref: 15 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.181138:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926ebe00, rc 0) 00000100:00100000:2.0:1789129324.181235:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626600320:12345-0@lo:101:mount.lustre.0 Request processed in 169us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129324.181242:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789129324.183593:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789129324.183651:0:15502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129324.183662:0:15502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789129324.187129:0:15502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789129324.193043:0:15502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789129324.193391:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789129324.193438:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789129324.193502:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789129324.193517:0:15502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789129324.197758:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129324.197839:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129324.197895:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48511bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789129324.198016:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626600448 00000100:00100000:1.0:1789129324.198025:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626600448 00000100:00100000:1.0:1789129324.198075:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789129324.198086:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626600448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789129324.198417:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626600448:12345-0@lo:501:mount.lustre.0 Request processed in 329us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129324.198448:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789129324.198824:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129324.198882:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789129324.198945:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129324.199026:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48511bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129324.205562:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626600576 00000100:00100000:2.0:1789129324.205591:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626600576 00000100:00100000:2.0:1789129324.205741:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789129324.205760:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626600576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789129324.206146:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626600576:12345-0@lo:503:mount.lustre.0 Request processed in 389us (7196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129324.206161:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789129324.207094:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600576:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789129324.208322:0:15502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789129324.208420:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383caf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789129324.208541:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129324.208854:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48511bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129324.211944:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626600704 00000100:00100000:2.0:1789129324.211961:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626600704 00000100:00100000:2.0:1789129324.212087:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789129324.212112:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626600704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789129324.214901:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626600704:12345-0@lo:502:mount.lustre.0 Request processed in 2780us (6349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129324.214918:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789129324.224460:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383caf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600704:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789129324.224918:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789129324.224993:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789129324.225061:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789129324.225102:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789129324.225136:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789129324.225182:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789129324.225249:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789129324.225783:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:1.0:1789129324.225843:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:1.0:1789129324.225881:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:1.0:1789129324.225927:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:1.0:1789129324.225987:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789129324.226104:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129324.226164:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5afa300 going to sleep for 11 seconds 00000100:00100000:0.0:1789129324.226366:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626600832 00000100:00100000:0.0:1789129324.226374:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626600832 00000100:00100000:0.0:1789129324.226464:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789129324.226481:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626600832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789129324.226850:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626600832:12345-0@lo:502:mount.lustre.0 Request processed in 373us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129324.226858:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789129324.231155:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789129324.231431:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:1.0:1789129324.231460:0:15502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789129324.236169:0:15520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789129324.236215:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129324.236220:0:15520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789129324.236234:0:15520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b489cb4000 00000020:00000080:1.0:1789129324.236240:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789129324.236253:0:15520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789129324.236778:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129324.236782:0:15520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789129324.236787:0:15520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789129324.236791:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129324.236809:0:15520:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789129324.236820:0:15520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b489cb4000 00000020:00000080:1.0:1789129324.236824:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789129324.238484:0:15520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789129324.238505:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129324.238509:0:15520:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789129324.238515:0:15520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789129324.238522:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129324.238525:0:15520:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789129324.238535:0:15520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b489cb4000 00000020:00000080:1.0:1789129324.238540:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789129324.244093:0:15520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789129324.244115:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129324.244118:0:15520:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789129324.244123:0:15520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789129324.244128:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129324.244130:0:15520:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789129324.244135:0:15520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b489cb4000 00000020:00000080:1.0:1789129324.244138:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789129324.244292:0:15520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789129324.244297:0:15520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789129324.244298:0:15520:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789129324.244301:0:15520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789129324.244658:0:15502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789129324.244696:0:15502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789129324.244718:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.244731:0:15502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129324.244788:0:15502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789129324.244791:0:15502:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b489cb4000 10000000:01000000:2.0:1789129324.244795:0:15502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b489cb4000 10000000:01000000:2.0:1789129324.244799:0:15502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789129324.244805:0:15502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b489cb4000 from 1 10000000:01000000:2.0:1789129324.244808:0:15502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789129324.244854:0:15502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eae00/0x5c74554e47ce5442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.244862:0:15502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4926eae00/0x5c74554e47ce5442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.244871:0:15502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4926eae00/0x5c74554e47ce5442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129324.244898:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789129324.244973:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129324.245047:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626600960 00000100:00100000:2.0:1789129324.245054:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626600960 00000100:00100000:2.0:1789129324.245099:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789129324.245109:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626600960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789129324.245125:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129324.245139:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4926eba00/0x5c74554e47ce5449 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce5442 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.245184:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4926eba00/0x5c74554e47ce5449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce5442 expref: 16 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.245202:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4926eba00/0x5c74554e47ce5449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce5442 expref: 16 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.245215:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eba00, rc 0) 00000100:00100000:2.0:1789129324.245750:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:15502:x1876037626600960:12345-0@lo:101:mount.lustre.0 Request processed in 634us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129324.245764:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789129324.245824:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860abc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129324.245849:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626600960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789129324.245868:0:15502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4926eae00/0x5c74554e47ce5442 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5449 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.245878:0:15502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4926eae00/0x5c74554e47ce5442 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce5449 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129324.247083:0:15502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789129324.251828:0:15502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789129324.252130:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789129324.252183:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789129324.252218:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789129324.252267:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789129324.252304:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789129324.252354:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789129324.252439:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789129324.252520:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789129324.252672:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789129324.252753:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789129324.252802:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789129324.252850:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789129324.252888:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789129324.252925:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789129324.252986:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789129324.275363:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789129324.275429:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789129324.275507:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789129324.275545:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789129324.275582:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789129324.275655:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789129324.275694:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789129324.275727:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789129324.275776:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789129324.275846:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789129324.275884:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789129324.275936:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789129324.275989:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789129324.280551:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789129324.280579:0:15502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789129324.280752:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626601088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129324.280829:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129324.280887:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789129324.281732:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626601088 00000100:00100000:2.0:1789129324.281743:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626601088 00000100:00100000:2.0:1789129324.281797:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789129324.281807:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:15502:x1876037626601088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789129324.284706:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:15502:x1876037626601088:12345-0@lo:501:mount.lustre.0 Request processed in 2889us (3866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129324.284721:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789129324.285039:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626601088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129324.285091:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626601216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789129324.285136:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129324.287374:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789129324.287484:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626601216 00000100:00100000:2.0:1789129324.287497:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626601216 00000100:00100000:2.0:1789129324.287569:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789129324.287580:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:15502:x1876037626601216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789129324.287844:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:15502:x1876037626601216:12345-0@lo:503:mount.lustre.0 Request processed in 265us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129324.287852:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789129324.288405:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626601216:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789129324.288994:0:15502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789129324.289100:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626601344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789129324.291401:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129324.291497:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789129324.292485:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626601344 00000100:00100000:2.0:1789129324.292508:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626601344 00000100:00100000:2.0:1789129324.292578:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789129324.292589:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:15502:x1876037626601344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789129324.292913:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:15502:x1876037626601344:12345-0@lo:502:mount.lustre.0 Request processed in 325us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129324.292922:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789129324.293730:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cae940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626601344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789129324.294226:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789129324.297792:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789129324.297908:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789129324.298040:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789129324.298116:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789129324.298242:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000100:00080000:2.0:1789129324.300797:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789129324.300817:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789129324.300822:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789129324.300827:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789129324.300963:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626601472:0@lo:400:kworker.0 00000100:00100000:2.0:1789129324.301088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129324.301168:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626601472 00000100:00100000:2.0:1789129324.301192:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626601472 00000100:00100000:2.0:1789129324.301252:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789129324.301262:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7889e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626601472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129324.301323:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7889e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626601472:12345-0@lo:400:kworker.0 Request processed in 62us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129324.301331:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789129324.301384:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b4a788a1c0 x1876037626601472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129324.301399:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626601472:0@lo:400:kworker.0 00000040:00080000:0.0:1789129324.301664:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789129324.301716:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789129324.301827:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789129324.301864:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789129324.301900:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789129324.301960:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789129324.301998:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789129324.308365:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789129324.308485:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789129324.308523:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789129324.308644:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789129324.308767:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789129324.308859:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789129324.308938:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789129324.309024:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789129324.309064:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789129324.309100:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789129324.309151:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789129324.314041:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789129324.314110:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789129324.314288:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789129324.314339:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789129324.314388:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789129324.314503:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789129324.314585:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789129324.314720:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789129324.314789:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789129324.314889:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789129324.314961:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789129324.315037:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789129324.315076:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789129324.315110:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789129324.323131:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789129324.324728:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789129324.324830:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626601600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789129324.325829:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129324.330020:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626601600 00000100:00100000:0.0:1789129324.330038:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626601600 00000100:00100000:0.0:1789129324.330142:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789129324.330155:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:15502:x1876037626601600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789129324.330494:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:15502:x1876037626601600:12345-0@lo:502:mount.lustre.0 Request processed in 339us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129324.330507:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789129324.333275:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143900 going to sleep for 11 seconds 00000100:00100000:0.0:1789129324.333326:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626601600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789129324.333497:0:15502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789129324.333514:0:15502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789129324.335032:0:15526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789129324.335061:0:15526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90b382b68000) 00000020:00000080:0.0:1789129324.335083:0:15526:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789129324.335161:0:15526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b489cb4000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789129324.335233:0:15526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b489cb4000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789129324.335237:0:15526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b489cb4000 3 00010000:00080000:0.0:1789129324.335274:0:15526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b4bb015800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.139@tcp at head 00010000:00010000:1.0:1789129324.342584:0:15526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789129324.343534:0:15526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789129324.343577:0:15526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789129324.343591:0:15526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5c74554e47ce5457 00000100:00080000:1.0:1789129324.343629:0:15526:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789129324.343637:0:15526:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90b4bb015800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789129324.343677:0:15526:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bae78f00 x1876037626601728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789129324.343703:0:15526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789129324.345202:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626601728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789129324.345293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789129324.345363:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789129324.345367:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789129324.345369:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789129324.345372:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789129324.345558:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626601728 00000100:00100000:1.0:1789129324.345567:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626601728 00000100:00100000:1.0:1789129324.345621:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789129324.345630:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876037626601728:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789129324.345657:0:14817:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1789129324.345707:0:14817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5c74554e47ce545e 00000004:00100000:1.0:1789129324.345722:0:14817:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789129324.345758:0:14817:0:(import.c:65:import_set_state_nolock()) ffff90b4856b9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789129324.345809:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876037626601728:12345-0@lo:38:llog_process_th.0 Request processed in 177us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129324.345817:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1789129324.345989:0:15526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:2.0:1789129324.346214:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90b4bae78f00 x1876037626601728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789129334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129324.346225:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789129324.346232:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789129324.346240:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789129324.346245:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789129324.346247:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b4bb015800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789129324.346253:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876037626601728:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1789129324.346297:0:15502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789129324.346331:0:15502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789129324.346346:0:15502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eae00/0x5c74554e47ce5442 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5449 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129324.346354:0:15502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926eae00/0x5c74554e47ce5442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5449 expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789129324.346410:0:15502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789129324.346412:0:15502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789129324.346413:0:15502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789129324.346415:0:15502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789129324.346416:0:15502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789129324.346417:0:15502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789129324.346418:0:15502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789129324.346420:0:15502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789129324.346422:0:15502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789129324.346426:0:15502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789129324.346429:0:15502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789129324.346430:0:15502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789129324.346431:0:15502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789129324.346432:0:15502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789129324.346433:0:15502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789129324.346434:0:15502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789129324.346435:0:15502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789129324.346436:0:15502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789129324.346436:0:15502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789129324.346470:0:15502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789129324.346487:0:15502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626601856:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789129324.346529:0:15502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129324.346549:0:15502:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860abf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789129324.346706:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626601856 00000100:00100000:2.0:1789129324.346713:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626601856 00000100:00100000:2.0:1789129324.346747:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789129324.346753:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:15502:x1876037626601856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789129324.346785:0:14809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789129324.346799:0:14809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789129324.415918:0:14809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789129324.416110:0:14809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789129324.418579:0:14832:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789129324.418592:0:14832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789129324.418644:0:14832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129324.418664:0:14832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce53d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce53cb expref: 16 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129324.418673:0:14832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129324.418718:0:14832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce53d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce53cb expref: 16 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129324.418742:0:14832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce53d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce53cb expref: 16 pid: 14809 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129324.418757:0:14832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cae940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14832:1876037626601984:0@lo:104: 00000100:00100000:0.0:1789129324.418830:0:14832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129324.418892:0:14832:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883fc540 going to sleep for 11 seconds 00000100:00100000:3.0:1789129324.418988:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626601984 00000100:00100000:3.0:1789129324.418995:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626601984 00000100:00100000:3.0:1789129324.419078:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789129324.419088:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+3:14832:x1876037626601984:12345-0@lo:104: 00010000:00010000:3.0:1789129324.419104:0:14799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.419343:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789129324.419351:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+3:14832:x1876037626601984:12345-0@lo:104: Request processed in 265us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129324.419359:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789129324.419384:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129324.419390:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.419398:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea600 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:3.0:1789129324.419401:0:14804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.419408:0:14804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789129324.419416:0:14804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789129324.419440:0:14804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789129324.419497:0:14804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.419508:0:14804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789129324.419544:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.419578:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce53cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce53d2 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.419651:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129324.419656:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129324.419659:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129324.419705:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bfd76cf-bae1-432b-b8fe-46974cf010df:3307:1876037626602112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789129324.419769:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129324.419868:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626602112 00000100:00100000:3.0:1789129324.419877:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626602112 00010000:00010000:3.0:1789129324.419912:0:14801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce53d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce53cb expref: 17 pid: 14809 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129324.420590:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789129324.420631:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:3307:x1876037626602112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129324.420648:0:14801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129324.420655:0:14801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce53d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce53cb expref: 17 pid: 14809 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.420677:0:14801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce53d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce53cb expref: 17 pid: 14809 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.420699:0:14801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.420707:0:14801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789129324.420723:0:14801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002132807s 00010000:00010000:3.0:1789129324.420741:0:14801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.420748:0:14801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.420756:0:14801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.420763:0:14801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.420769:0:14801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129324.420773:0:14801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.420782:0:14801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.420792:0:14801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.420802:0:14801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129324.420859:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:3307:x1876037626602112:12345-0@lo:103:ldlm_bl.0 Request processed in 259us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129324.420868:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789129324.421037:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bfd76cf-bae1-432b-b8fe-46974cf010df:3307:1876037626602112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129324.421826:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce53d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce53cb expref: 16 pid: 14809 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129324.421844:0:14832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cae940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14832:1876037626601984:0@lo:104: 00010000:00010000:3.0:1789129324.421873:0:14832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.421900:0:14832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.421909:0:14832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129324.421916:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5465 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129324.435590:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:15502:x1876037626601856:12345-0@lo:253:mount.lustre.0 Request processed in 88824us (89048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129324.435619:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789129324.435732:0:15502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:15502:1876037626601856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789129324.435748:0:15502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789129324.435751:0:15502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789129324.435752:0:15502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789129324.435754:0:15502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789129324.435755:0:15502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789129324.435757:0:15502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789129324.435758:0:15502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789129324.435759:0:15502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789129324.435761:0:15502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789129324.435762:0:15502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789129324.435779:0:15502:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789129324.445254:0:15502:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789129324.445554:0:15502:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789129324.446104:0:15502:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789129324.446343:0:15502:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789129324.447017:0:15502:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789129324.447268:0:15502:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789129324.448389:0:15502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789129324.513768:0:15502:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789129324.513784:0:15502:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789129324.513856:0:15502:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789129324.513952:0:15502:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789129324.513977:0:15502:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789129324.514019:0:15502:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789129324.552977:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129325.573964:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789129326.025095:0:14813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789129326.025105:0:14813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b49bdce800 from 7 10000000:01000000:1.0:1789129326.025111:0:14813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789129326.025175:0:14813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129326.025188:0:14813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129326.025200:0:14813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129326.025230:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626602240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789129326.025329:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129326.025391:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626602240 00000100:00100000:2.0:1789129326.025402:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626602240 00000100:00100000:1.0:1789129326.025404:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789129326.025739:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789129326.025751:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+15:14813:x1876037626602240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129326.025773:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129326.025794:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce5473 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce546c expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129326.025830:0:14811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce5473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce546c expref: 16 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129326.025843:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce5473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce546c expref: 16 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129326.025855:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb600, rc 0) 00000100:00100000:2.0:1789129326.025915:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:14813:x1876037626602240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129326.027785:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626602240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129326.027823:0:14813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129326.027839:0:14813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129326.027936:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626602368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789129326.028031:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129326.028075:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497eead80 going to sleep for 11 seconds 00000100:00100000:3.0:1789129326.028100:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626602368 00000100:00100000:3.0:1789129326.028107:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626602368 00000100:00100000:2.0:1789129326.029752:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789129326.031593:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789129326.031941:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:14813:x1876037626602368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789129326.031994:0:14809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789129326.032022:0:14809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789129326.032025:0:14809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789129326.032209:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:14813:x1876037626602368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 288us (4175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129326.032220:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789129326.032311:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626602368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789129326.034388:0:14813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789129326.034425:0:14813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129326.034443:0:14813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789129326.279205:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789129326.598182:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129327.625642:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129328.646225:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129329.415580:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626602496:0@lo:400:kworker.0 00000100:00100000:0.0:1789129329.417592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789129329.417968:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789129329.417975:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789129329.417978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789129329.417982:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789129329.418132:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789129329.418146:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626602624:0@lo:400:kworker.0 00000100:00100000:0.0:1789129329.418189:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129329.418269:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626602496 00000100:00100000:0.0:1789129329.418280:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626602496 00000100:00100000:0.0:1789129329.418335:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789129329.418346:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:3308:x1876037626602496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129329.418402:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:3308:x1876037626602496:12345-0@lo:400:kworker.0 Request processed in 58us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129329.418411:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789129329.418464:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626602496:0@lo:400:kworker.0 00000100:00100000:0.0:1789129329.418592:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626602752:0@lo:400:kworker.0 00000100:00100000:0.0:1789129329.418667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129329.419010:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626602624 00000100:00100000:2.0:1789129329.419016:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626602624 00000100:00100000:3.0:1789129329.419060:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626602752 00000100:00100000:3.0:1789129329.419073:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626602752 00000100:00100000:2.0:1789129329.419144:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789129329.419154:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626602624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129329.419203:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626602624:12345-0@lo:400:kworker.0 Request processed in 51us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129329.419210:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789129329.419278:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789129329.419286:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626602752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129329.419328:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626602752:12345-0@lo:400:kworker.0 Request processed in 44us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129329.419335:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789129329.419372:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bacd2580 x1876037626602752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129329.419386:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626602752:0@lo:400:kworker.0 00000100:00080000:0.0:1789129329.419478:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789129329.419502:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bacd1680 x1876037626602624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129329.419513:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626602624:0@lo:400:kworker.0 00000100:00100000:1.0:1789129329.482582:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789129314/real 1789129314] req@ffff90b4bacd3480 x1876037626598016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789129329 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129329.482640:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90b4bacd3480 x1876037626598016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789129329 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129329.482651:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789129314/real 1789129314] req@ffff90b4bacd1e00 x1876037626598144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789129329 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129329.482664:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90b4bacd1e00 x1876037626598144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789129329 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789129329.482691:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d0d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789129329.482721:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789129329.482727:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626598016:0@lo:8:kworker.0 00000100:00080000:1.0:1789129329.482734:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789129329.482740:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789129329.482744:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626598144:0@lo:8:kworker.0 00000100:00080000:1.0:1789129329.482798:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789129329.482804:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789129329.482808:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b485d0d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789129329.482814:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1789129329.482822:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789129329.482831:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90b485d0d800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789129329.482892:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bae7a1c0 x1876037626602880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789129329.482925:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789129329.482940:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789129329.482942:0:36:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789129329.482946:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1789129329.482950:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789129329.482954:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b485d09000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789129329.482968:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bae78f00 x1876037626603008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789129329.482999:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626602880:0@lo:8:kworker.0 00000100:00100000:1.0:1789129329.483088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129329.483139:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626603008:0@lo:8:kworker.0 00000100:00100000:1.0:1789129329.483161:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129329.483643:0:15505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626602880 00000100:00100000:2.0:1789129329.483654:0:15505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626602880 00000100:00100000:2.0:1789129329.483688:0:15505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626603008 00000100:00100000:2.0:1789129329.483691:0:15505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626603008 00000100:00100000:2.0:1789129329.483706:0:15505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789129329.483716:0:15505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876037626602880:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789129329.483754:0:15505:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1789129329.483793:0:15505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce547a 00002000:00100000:2.0:1789129329.483814:0:15505:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90b488b5a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789129329.483819:0:15505:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789129329.483823:0:15505:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789129329.484482:0:15505:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789129329.484522:0:15505:0:(import.c:65:import_set_state_nolock()) ffff90b488b5d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789129329.484714:0:15505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876037626602880:12345-0@lo:8:kworker.0 Request processed in 996us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129329.484725:0:15505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789129329.484754:0:15505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789129329.484774:0:15505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876037626603008:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789129329.484792:0:15505:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789129329.484824:0:15505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876037626603008:12345-0@lo:8:kworker.0 Request processed in 51us (1662us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789129329.484831:0:15505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789129329.487279:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bae7a1c0 x1876037626602880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789129349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789129329.487299:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789129329.487312:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789129329.487323:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789129329.487331:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789129329.487336:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d0d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789129329.487368:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789129329.487376:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626602880:0@lo:8:kworker.0 00000100:00080000:1.0:1789129329.487393:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789129329.487398:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789129329.487401:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626603008:0@lo:8:kworker.0 00000004:00080000:3.0:1789129329.487533:0:14839:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789129329.487560:0:14839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14839:1876037626603264:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789129329.487670:0:14839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129329.487703:0:14839:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49106bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129329.487718:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129329.487727:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626603136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129329.487758:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789129329.487838:0:14838:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789129329.488265:0:14838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 492585661037ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789129329.488322:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626603136 00000100:00100000:0.0:1789129329.488332:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626603136 00000100:00100000:0.0:1789129329.488401:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789129329.488412:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626603136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129329.488455:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129329.488520:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876037626603136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129329.488540:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789129329.488566:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789129329.488775:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bacd2580 x1876037626603136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129329.488798:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626603136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129329.489501:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626603264 00000100:00100000:1.0:1789129329.489512:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626603264 00000100:00100000:1.0:1789129329.489570:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789129329.489579:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14839:x1876037626603264:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789129329.491967:0:15506:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789129329.491984:0:15506:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789129329.491991:0:15506:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1789129329.507564:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.507583:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce5481 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.507638:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.507645:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.507653:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce5481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.507679:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce5481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.507693:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce5481 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.507701:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce5481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.507724:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789129329.509422:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789129329.509438:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce5481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129329.509455:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dac00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129329.509461:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce5481 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129329.509482:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce5481 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129329.509518:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce5481 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129329.509527:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce5481 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129329.509557:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129329.509559:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129329.509561:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.511469:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.511486:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce5488 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.511520:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.511526:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.511534:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce5488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.511553:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce5488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.511568:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce5488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.511577:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce5488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.511630:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.511650:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.511657:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce5488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.511666:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58db200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.511672:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce5488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.511683:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce5488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.511716:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce5488 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.511725:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce5488 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.511745:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.511747:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.511749:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.515033:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.515050:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce548f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515071:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.515077:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.515086:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce548f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515103:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce548f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515115:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce548f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515125:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce548f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515164:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.515181:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.515189:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce548f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515197:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58da400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.515202:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce548f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515211:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce548f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515232:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce548f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515240:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce548f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515261:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.515263:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.515267:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.515755:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.515762:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce5496 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515772:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.515782:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.515787:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce5496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515798:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce5496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515807:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce5496 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515814:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce5496 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515830:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.515840:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.515845:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce5496 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.515853:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dbc00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.517486:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce5496 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.517524:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce5496 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.517548:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce5496 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.517572:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce5496 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.517598:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.517625:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.517628:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.520770:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.520789:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce549d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.520814:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.520820:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.520830:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce549d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.520850:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce549d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.524271:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce549d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.524295:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce549d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.524469:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.524489:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.524505:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce549d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.524515:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58db800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.524521:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce549d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.524532:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce549d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.524561:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce549d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.524569:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce549d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.524596:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.524598:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.524649:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.525380:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.525390:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce54a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.525407:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.525413:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.525422:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce54a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.525449:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce54a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.525459:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce54a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.525468:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce54a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.525488:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.525500:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.525505:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce54a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.525513:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58db200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.525517:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce54a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.525526:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce54a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.525540:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce54a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.525549:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cba6989/0x5c74554e47ce54a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.525571:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.525573:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.525575:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.526021:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.526028:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f0ecd43/0x5c74554e47ce54ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526038:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.526041:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.526046:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f0ecd43/0x5c74554e47ce54ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526056:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f0ecd43/0x5c74554e47ce54ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526065:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f0ecd43/0x5c74554e47ce54ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526072:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f0ecd43/0x5c74554e47ce54ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526087:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.526097:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.526102:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f0ecd43/0x5c74554e47ce54ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526121:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58db400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.526125:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f0ecd43/0x5c74554e47ce54ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526134:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f0ecd43/0x5c74554e47ce54ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526147:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f0ecd43/0x5c74554e47ce54ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526155:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f0ecd43/0x5c74554e47ce54ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526169:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.526171:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.526172:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.526598:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.526632:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040174ed0/0x5c74554e47ce54b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526642:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.526646:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.526650:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040174ed0/0x5c74554e47ce54b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526660:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040174ed0/0x5c74554e47ce54b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526676:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040174ed0/0x5c74554e47ce54b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526684:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040174ed0/0x5c74554e47ce54b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526700:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.526710:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.526715:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040174ed0/0x5c74554e47ce54b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526723:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dae00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.526726:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040174ed0/0x5c74554e47ce54b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526735:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040174ed0/0x5c74554e47ce54b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526747:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040174ed0/0x5c74554e47ce54b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526755:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040174ed0/0x5c74554e47ce54b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.526770:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.526779:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.526780:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.527205:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.527211:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000463fa572/0x5c74554e47ce54b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.527221:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.527224:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.527229:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000463fa572/0x5c74554e47ce54b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.527239:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000463fa572/0x5c74554e47ce54b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.527248:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000463fa572/0x5c74554e47ce54b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.527256:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000463fa572/0x5c74554e47ce54b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.527271:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.527280:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.527284:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000463fa572/0x5c74554e47ce54b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.527293:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dba00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.527297:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000463fa572/0x5c74554e47ce54b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.527318:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000463fa572/0x5c74554e47ce54b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.527330:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000463fa572/0x5c74554e47ce54b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.527339:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000463fa572/0x5c74554e47ce54b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.527354:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.527355:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.527357:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.533534:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.533549:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce54c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.533570:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.533576:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.533585:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce54c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.537757:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce54c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.537792:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce54c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.537812:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce54c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.537866:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789129329.538655:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.538667:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce54c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538684:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.538691:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.538699:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce54c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538715:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce54c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538725:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce54c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538732:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce54c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538755:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789129329.538772:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789129329.538780:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce54c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538796:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dbc00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.538802:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce54c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538812:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce54c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538834:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce54c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538843:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b259c54d/0x5c74554e47ce54c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538864:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.538867:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce54c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538873:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58da400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.538876:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce54c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538884:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce54c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538894:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce54c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538919:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000835d7e2a/0x5c74554e47ce54c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.538935:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.538937:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.538939:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.539416:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.539423:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce54ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.539433:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.539438:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.539443:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce54ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.539455:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce54ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.539464:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce54ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.539473:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce54ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.539490:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.539499:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.539509:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce54ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.539517:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58db800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.539521:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce54ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.539530:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce54ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.539542:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce54ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.539550:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b25e82c/0x5c74554e47ce54ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.539565:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.539568:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.539569:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129329.542839:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.544246:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.544264:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aac69226/0x5c74554e47ce54d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.544286:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.544291:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.544300:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aac69226/0x5c74554e47ce54d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.544329:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aac69226/0x5c74554e47ce54d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.544341:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aac69226/0x5c74554e47ce54d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.544349:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aac69226/0x5c74554e47ce54d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.544376:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789129329.544984:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.544993:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead7c73e/0x5c74554e47ce54dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545003:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.545007:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.545012:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead7c73e/0x5c74554e47ce54dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545024:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ead7c73e/0x5c74554e47ce54dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545034:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ead7c73e/0x5c74554e47ce54dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545053:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ead7c73e/0x5c74554e47ce54dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545075:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789129329.545091:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789129329.545098:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aac69226/0x5c74554e47ce54d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545108:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58daa00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.545113:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aac69226/0x5c74554e47ce54d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545123:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aac69226/0x5c74554e47ce54d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545144:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aac69226/0x5c74554e47ce54d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545153:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aac69226/0x5c74554e47ce54d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545176:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.545180:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ead7c73e/0x5c74554e47ce54dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545199:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58da600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.545202:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead7c73e/0x5c74554e47ce54dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545211:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ead7c73e/0x5c74554e47ce54dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545222:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ead7c73e/0x5c74554e47ce54dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545230:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ead7c73e/0x5c74554e47ce54dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545242:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.545244:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.545246:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.545675:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.545682:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6f10d8/0x5c74554e47ce54e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545693:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.545697:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.545702:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b6f10d8/0x5c74554e47ce54e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545712:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b6f10d8/0x5c74554e47ce54e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545727:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6f10d8/0x5c74554e47ce54e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545734:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b6f10d8/0x5c74554e47ce54e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545750:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.545759:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.545762:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b6f10d8/0x5c74554e47ce54e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545769:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58da000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.545773:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6f10d8/0x5c74554e47ce54e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545781:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6f10d8/0x5c74554e47ce54e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545791:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b6f10d8/0x5c74554e47ce54e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545799:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b6f10d8/0x5c74554e47ce54e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.545815:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.545822:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.545824:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.546242:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.546249:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55ed571/0x5c74554e47ce54ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546258:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.546261:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.546267:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55ed571/0x5c74554e47ce54ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546276:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e55ed571/0x5c74554e47ce54ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546285:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55ed571/0x5c74554e47ce54ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546293:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e55ed571/0x5c74554e47ce54ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546309:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.546317:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.546321:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e55ed571/0x5c74554e47ce54ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546327:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58db600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.546330:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55ed571/0x5c74554e47ce54ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546349:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55ed571/0x5c74554e47ce54ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546360:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e55ed571/0x5c74554e47ce54ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546367:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e55ed571/0x5c74554e47ce54ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546382:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.546384:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.546386:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.546805:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.546812:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce54f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546820:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.546824:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.546828:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce54f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546837:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce54f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546846:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce54f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546859:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce54f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546873:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.546882:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.546886:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce54f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.546894:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dac00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.546897:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce54f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.546988:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.551053:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce54f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.551115:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce54f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.551125:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eeea7f5/0x5c74554e47ce54f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.551163:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.551166:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.551170:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.553326:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.553353:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac03131b/0x5c74554e47ce54f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.553373:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.553380:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.553388:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac03131b/0x5c74554e47ce54f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.553405:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac03131b/0x5c74554e47ce54f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.553416:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac03131b/0x5c74554e47ce54f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.553423:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac03131b/0x5c74554e47ce54f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.553444:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789129329.553708:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129329.553716:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac03131b/0x5c74554e47ce54f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.553726:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129329.553731:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac03131b/0x5c74554e47ce54f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.553743:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac03131b/0x5c74554e47ce54f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.553768:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac03131b/0x5c74554e47ce54f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.553777:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac03131b/0x5c74554e47ce54f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.553803:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129329.553805:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129329.553807:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.558145:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.558166:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce54ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.558189:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.558195:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.558203:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce54ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.558221:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce54ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.558241:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce54ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.558249:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce54ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.558279:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.558305:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.558312:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce54ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.558321:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.558326:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce54ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.558338:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce54ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.558362:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce54ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.558370:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce54ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.558396:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.558404:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.558406:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.559307:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.559319:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df2bcad4/0x5c74554e47ce5506 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.559332:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.559337:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.559343:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df2bcad4/0x5c74554e47ce5506 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.559355:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df2bcad4/0x5c74554e47ce5506 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.559365:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df2bcad4/0x5c74554e47ce5506 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.559373:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df2bcad4/0x5c74554e47ce5506 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.559407:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789129329.559939:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.559947:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029079fa2/0x5c74554e47ce550d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.559957:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.559961:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.559966:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029079fa2/0x5c74554e47ce550d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.559984:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029079fa2/0x5c74554e47ce550d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.559993:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029079fa2/0x5c74554e47ce550d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560000:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029079fa2/0x5c74554e47ce550d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560017:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789129329.560034:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789129329.560040:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df2bcad4/0x5c74554e47ce5506 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560049:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031e00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.560055:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df2bcad4/0x5c74554e47ce5506 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560065:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df2bcad4/0x5c74554e47ce5506 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560080:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df2bcad4/0x5c74554e47ce5506 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560087:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df2bcad4/0x5c74554e47ce5506 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560114:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.560118:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029079fa2/0x5c74554e47ce550d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560125:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.560128:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029079fa2/0x5c74554e47ce550d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560137:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029079fa2/0x5c74554e47ce550d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560146:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029079fa2/0x5c74554e47ce550d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560154:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029079fa2/0x5c74554e47ce550d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560164:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.560166:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.560168:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.560634:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.560640:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5514 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560650:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.560653:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.560664:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560675:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560684:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560692:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560710:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.560720:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.560725:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560732:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.560736:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560745:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560758:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5514 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560777:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5514 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.560793:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.560794:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.560796:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129329.560984:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.562729:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.562818:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce551b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.562837:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.562842:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.562849:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce551b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.564168:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce551b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.564190:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce551b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.564199:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce551b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.564224:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129329.564243:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129329.564272:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce551b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.564280:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129329.564285:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce551b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.564294:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce551b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.564318:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce551b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.564325:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce551b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.564354:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.564356:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.564358:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.567363:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.567381:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda96f65/0x5c74554e47ce5522 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.567404:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.567410:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.567418:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dda96f65/0x5c74554e47ce5522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.567449:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dda96f65/0x5c74554e47ce5522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.567462:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dda96f65/0x5c74554e47ce5522 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.567470:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dda96f65/0x5c74554e47ce5522 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.567497:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789129329.568102:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129329.568113:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dda96f65/0x5c74554e47ce5522 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.568132:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129329.568137:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda96f65/0x5c74554e47ce5522 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.568149:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dda96f65/0x5c74554e47ce5522 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.568177:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dda96f65/0x5c74554e47ce5522 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.568185:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dda96f65/0x5c74554e47ce5522 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.568211:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129329.568213:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129329.568215:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.569360:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.569373:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7de42cf/0x5c74554e47ce5529 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.569390:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.569395:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.569403:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7de42cf/0x5c74554e47ce5529 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.569419:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7de42cf/0x5c74554e47ce5529 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.569430:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7de42cf/0x5c74554e47ce5529 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.569449:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7de42cf/0x5c74554e47ce5529 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.569477:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789129329.570960:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129329.570977:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7de42cf/0x5c74554e47ce5529 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.570994:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129329.571000:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7de42cf/0x5c74554e47ce5529 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.571013:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7de42cf/0x5c74554e47ce5529 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.571053:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7de42cf/0x5c74554e47ce5529 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.571062:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7de42cf/0x5c74554e47ce5529 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.571093:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129329.571095:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129329.571098:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.578241:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.578259:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce5530 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.578280:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.578287:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.578296:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce5530 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.578313:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce5530 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.578326:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce5530 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.578335:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce5530 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.578354:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789129329.578919:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789129329.578929:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce5530 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.578939:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129329.578944:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce5530 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.578954:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce5530 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.578975:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce5530 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.578983:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070f31a06/0x5c74554e47ce5530 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129329.579022:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129329.579024:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129329.579026:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789129329.583561:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.583580:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce5537 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.583643:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.583649:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.583657:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce5537 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.583673:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce5537 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.583684:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce5537 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.583692:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce5537 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.583712:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789129329.584414:0:15506:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789129329.584422:0:15506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce553e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.584433:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1789129329.584437:0:15506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129329.584443:0:15506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce553e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.584454:0:15506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce553e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.584474:0:15506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce553e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.584482:0:15506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce553e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129329.584505:0:15506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1789129329.584725:0:15506:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1789129329.590310:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14839:x1876037626603264:12345-0@lo:5:osp-pre-0-0.0 Request processed in 100718us (102626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129329.590328:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789129329.590479:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789129329.590492:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce5537 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129329.590508:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129329.590513:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce5537 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129329.590527:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce5537 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129329.590557:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce5537 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129329.590567:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a95235f6/0x5c74554e47ce5537 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129329.590595:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129329.590631:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce553e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129329.590639:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129329.590662:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce553e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129329.590671:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce553e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129329.590681:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce553e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129329.590688:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0fc22ce/0x5c74554e47ce553e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129329.590704:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129329.590705:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129329.590707:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129329.590844:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129329.591704:0:14839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14839:1876037626603264:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789129329.591729:0:14839:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789129329.591808:0:14839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7888780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14839:1876037626603392:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789129329.591890:0:14839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129329.591955:0:14839:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4964c7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789129329.591988:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626603392 00000100:00100000:2.0:1789129329.591996:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626603392 00000100:00100000:2.0:1789129329.592051:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789129329.592062:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7889680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14839:x1876037626603392:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789129329.592120:0:15504:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789129329.598371:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7889680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14839:x1876037626603392:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6301us (6471us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789129329.598397:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789129329.598472:0:14839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7888780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14839:1876037626603392:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789129329.598494:0:14839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:2.0:1789129329.637169:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789129329.670363:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789129330.124714:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789129330.124740:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789129330.693915:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129331.724007:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789129332.386111:0:15873:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789129332.742113:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129333.766582:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789129334.533723:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789129334.533731:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789129334.533736:0:38:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789129334.533745:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1789129334.533752:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789129334.533759:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b485d09000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789129334.533786:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bae7b840 x1876037626603776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789129334.533798:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626603520:0@lo:400:kworker.0 00000100:00100000:1.0:1789129334.533852:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626603648:0@lo:400:kworker.0 00000100:00100000:1.0:1789129334.544141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129334.544235:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789129334.544252:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7888f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626604160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129334.544347:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129334.544400:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626603776:0@lo:8:kworker.0 00000100:00100000:1.0:1789129334.544426:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129334.544620:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626603904:0@lo:400:kworker.0 00000100:00100000:1.0:1789129334.544654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129334.544678:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789129334.544685:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626604032:0@lo:400:kworker.0 00000100:00100000:1.0:1789129334.544710:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129334.545240:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626603904 00000100:00100000:3.0:1789129334.545249:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626603904 00000100:00100000:3.0:1789129334.545294:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626604032 00000100:00100000:3.0:1789129334.545298:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626604032 00000100:00100000:3.0:1789129334.545325:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789129334.545334:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626603904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129334.545403:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626603904:12345-0@lo:400:kworker.0 Request processed in 70us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129334.545411:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789129334.545425:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789129334.545431:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626604032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129334.545459:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626604032:12345-0@lo:400:kworker.0 Request processed in 29us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129334.545474:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789129334.545494:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129334.547831:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129334.547888:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626604160 00000100:00100000:0.0:1789129334.547895:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626604160 00000100:00100000:0.0:1789129334.547950:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789129334.547959:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626604160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129334.547993:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129334.548048:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626604160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (3702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129334.548180:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626603520 00000100:00100000:2.0:1789129334.548185:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626603520 00000100:00100000:2.0:1789129334.548213:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789129334.548219:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:3308:x1876037626603520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129334.548251:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:3308:x1876037626603520:12345-0@lo:400:kworker.0 Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129334.548258:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789129334.548315:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789129334.549040:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129334.549395:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626603520:0@lo:400:kworker.0 00000100:00100000:1.0:1789129334.551669:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626603648 00000100:00100000:1.0:1789129334.551686:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626603648 00000100:00100000:1.0:1789129334.551753:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626603776 00000100:00100000:1.0:1789129334.551757:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626603776 00000100:00100000:1.0:1789129334.551773:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789129334.551782:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626603648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129334.551883:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626603648:12345-0@lo:400:kworker.0 Request processed in 102us (7754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129334.551891:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789129334.551907:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789129334.551911:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876037626603776:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789129334.551930:0:15506:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789129334.552860:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bae7b0c0 x1876037626604032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129334.552877:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626604032:0@lo:400:kworker.0 00010000:00080000:0.0:1789129334.552890:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bae79a40 x1876037626603904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129334.552898:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626603904:0@lo:400:kworker.0 00000100:00100000:3.0:1789129334.555747:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789129334.555807:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7888f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626604160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129334.555834:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626603648:0@lo:400:kworker.0 00000100:00100000:1.0:1789129334.605121:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876037626603776:12345-0@lo:8:kworker.0 Request processed in 53197us (60682us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789129334.605139:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789129334.605205:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789129334.605212:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789129334.605216:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626603776:0@lo:8:kworker.0 00010000:00010000:2.0:1789129334.790500:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129335.813977:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789129336.524345:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789129336.855796:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129337.862157:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129338.901397:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789129339.661280:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789129339.661288:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789129339.661293:0:38:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789129339.661303:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:3.0:1789129339.661308:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789129339.661315:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b485d09000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:3.0:1789129339.661341:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bacd21c0 x1876037626604544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789129339.661461:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626604288:0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.661537:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129339.661588:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626604928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129339.661636:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129339.661665:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789129339.661670:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626604800:0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.661697:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129339.661739:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626604416:0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.661765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129339.661797:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789129339.661802:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626604672:0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.661825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129339.661882:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626604288 00000100:00100000:3.0:1789129339.661893:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626604288 00000100:00100000:3.0:1789129339.661940:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789129339.661950:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:3309:x1876037626604288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.663862:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:3309:x1876037626604288:12345-0@lo:400:kworker.0 Request processed in 1897us (2307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129339.663878:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789129339.663972:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626604928 00000100:00100000:3.0:1789129339.663981:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626604928 00000100:00100000:3.0:1789129339.665796:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789129339.665817:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626604928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129339.665868:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129339.665966:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626604928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (4328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129339.665973:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789129339.666011:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626604800 00000100:00100000:3.0:1789129339.666018:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626604800 00000100:00100000:3.0:1789129339.666051:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626604672 00000100:00100000:3.0:1789129339.666056:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626604672 00000100:00100000:3.0:1789129339.666071:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789129339.666077:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626604800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.666113:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626604800:12345-0@lo:400:kworker.0 Request processed in 37us (4416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129339.666120:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789129339.666131:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789129339.666155:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626604672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.666193:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626604672:12345-0@lo:400:kworker.0 Request processed in 39us (4366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129339.666198:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789129339.666224:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626604416 00000100:00100000:3.0:1789129339.666228:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626604416 00000100:00100000:3.0:1789129339.666255:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789129339.666262:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626604416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.666292:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626604416:12345-0@lo:400:kworker.0 Request processed in 31us (4526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129339.666298:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789129339.666323:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789129339.666328:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789129339.666673:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bacd30c0 x1876037626604672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129339.666689:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626604672:0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.666704:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626604416:0@lo:400:kworker.0 00010000:00080000:3.0:1789129339.666765:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b4bacd12c0 x1876037626604800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129339.666775:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626604800:0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.666786:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626604288:0@lo:400:kworker.0 00000100:00100000:3.0:1789129339.666802:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626604928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129339.668261:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626604544:0@lo:8:kworker.0 00000100:00100000:1.0:1789129339.668354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129339.670863:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626604544 00000100:00100000:2.0:1789129339.670877:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626604544 00000100:00100000:2.0:1789129339.670939:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789129339.670948:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876037626604544:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789129339.670972:0:15506:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789129339.693424:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876037626604544:12345-0@lo:8:kworker.0 Request processed in 22465us (25059us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789129339.693443:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789129339.693699:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789129339.693705:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789129339.693716:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626604544:0@lo:8:kworker.0 00010000:00010000:1.0:1789129339.915015:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129340.934457:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789129341.110109:0:16223:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789129341.110128:0:16223:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789129341.110902:0:16223:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90b4bb015000 00000020:01000004:0.0:1789129341.110948:0:16223:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789129341.110968:0:16223:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789129341.110998:0:16223:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90b382b69a48) 00000020:00000080:0.0:1789129341.111016:0:16223:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789129341.164905:0:16223:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789129341.165781:0:16223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789129341.167748:0:16223:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789129341.168024:0:16223:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789129341.168500:0:16223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789129341.169567:0:16223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 243: rc = 0 00100000:10000000:3.0:1789129341.169696:0:16223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 243: rc = 0 00100000:10000000:3.0:1789129341.169823:0:16223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 243: rc = 0 00100000:10000000:3.0:1789129341.170746:0:16223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 566: rc = 0 00100000:10000000:3.0:1789129341.171103:0:16223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 566: rc = 0 00100000:10000000:3.0:1789129341.171570:0:16223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 566: rc = 0 00100000:10000000:2.0:1789129341.172100:0:16223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 566: rc = 0 00100000:10000000:2.0:1789129341.172435:0:16223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 566: rc = 0 00100000:10000000:2.0:1789129341.172758:0:16223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 566: rc = 0 00000020:00000080:2.0:1789129341.173428:0:16223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789129341.173445:0:16223:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789129341.173458:0:16223:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5c74554e47ce554c 00000020:01000004:2.0:1789129341.173468:0:16223:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789129341.173493:0:16223:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789129341.173497:0:16223:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789129341.173505:0:16223:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789129341.173534:0:16223:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789129341.173540:0:16223:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789129341.188945:0:16223:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789129341.188989:0:16223:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.139@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789129341.188995:0:16223:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789129341.188997:0:16223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789129341.188998:0:16223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789129341.188999:0:16223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789129341.189000:0:16223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789129341.189001:0:16223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789129341.189003:0:16223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789129341.189005:0:16223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789129341.189006:0:16223:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789129341.189010:0:16223:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789129341.189013:0:16223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789129341.189014:0:16223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789129341.189015:0:16223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789129341.189016:0:16223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789129341.189017:0:16223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789129341.189019:0:16223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789129341.189020:0:16223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789129341.189021:0:16223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789129341.189022:0:16223:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789129341.189054:0:16223:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789129341.189077:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605056:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789129341.189177:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.189303:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143240 going to sleep for 11 seconds 00000100:00100000:0.0:1789129341.189544:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626605056 00000100:00100000:0.0:1789129341.189556:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626605056 00000100:00100000:0.0:1789129341.189967:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789129341.189979:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:16223:x1876037626605056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789129341.190020:0:14811:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789129341.190024:0:14811:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789129341.190028:0:14811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789129341.230156:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:16223:x1876037626605056:12345-0@lo:253:mount.lustre.0 Request processed in 40169us (40969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129341.230172:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789129341.235997:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789129341.236024:0:16223:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789129341.236029:0:16223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789129341.236031:0:16223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789129341.236033:0:16223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789129341.236034:0:16223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789129341.236035:0:16223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789129341.236037:0:16223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789129341.236039:0:16223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789129341.236041:0:16223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789129341.236042:0:16223:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789129341.236081:0:16223:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90b4bb015000 from lustre-OST0001 10000000:01000000:2.0:1789129341.236118:0:16223:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789129341.236121:0:16223:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789129341.236132:0:16223:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90b4b5764ed8 local copy 00010000:00010000:2.0:1789129341.236145:0:16223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce52f9 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129341.236448:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789129341.236530:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.236584:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497eea600 going to sleep for 11 seconds 00000100:00100000:3.0:1789129341.236856:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626605184 00000100:00100000:3.0:1789129341.236866:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626605184 00000100:00100000:3.0:1789129341.236918:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789129341.236928:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:16223:x1876037626605184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789129341.237361:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:16223:x1876037626605184:12345-0@lo:501:mount.lustre.0 Request processed in 432us (828us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789129341.237370:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789129341.237816:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605184:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789129341.237937:0:16223:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789129341.238132:0:16223:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789129341.238143:0:16223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce52f9 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129341.238154:0:16223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b488bf2c00/0x5c74554e47ce52f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce52f9 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129341.238197:0:16223:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90b4bb015000 10000000:01000000:2.0:1789129341.238202:0:16223:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789129341.238208:0:16223:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789129341.238211:0:16223:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789129341.238216:0:16223:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789129341.238220:0:16223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789129341.238253:0:16223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce5553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129341.238262:0:16223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce5553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129341.238273:0:16223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce5553 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129341.238293:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789129341.238418:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.238513:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497eea0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129341.238556:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626605312 00000100:00100000:0.0:1789129341.238562:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626605312 00000100:00100000:0.0:1789129341.238806:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789129341.238818:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:16223:x1876037626605312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789129341.238833:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129341.238850:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b490363000/0x5c74554e47ce555a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce5553 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.238879:0:14811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490363000/0x5c74554e47ce555a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce5553 expref: 17 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.238891:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b490363000/0x5c74554e47ce555a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce5553 expref: 17 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.238899:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363000, rc 0) 00000100:00100000:0.0:1789129341.238957:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:16223:x1876037626605312:12345-0@lo:101:mount.lustre.0 Request processed in 142us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129341.238964:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789129341.239037:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789129341.239052:0:16223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce5553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce555a expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129341.239061:0:16223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce5553 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce555a expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129341.239784:0:16223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789129341.240722:0:16223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789129341.240981:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789129341.241037:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789129341.241075:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789129341.241128:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789129341.241169:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789129341.241227:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789129341.241300:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789129341.241309:0:16223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789129341.241395:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789129341.241459:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.242271:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497eea600 going to sleep for 11 seconds 00000100:00100000:3.0:1789129341.242524:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626605440 00000100:00100000:3.0:1789129341.242534:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626605440 00000100:00100000:3.0:1789129341.242584:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789129341.242595:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:16223:x1876037626605440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789129341.251268:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:16223:x1876037626605440:12345-0@lo:501:mount.lustre.0 Request processed in 8665us (9797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129341.251297:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789129341.251514:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789129341.251577:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789129341.251875:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.251962:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b497eea600 going to sleep for 11 seconds 00000100:00100000:0.0:1789129341.252008:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626605568 00000100:00100000:0.0:1789129341.252016:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626605568 00000100:00100000:0.0:1789129341.252112:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789129341.252125:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:16223:x1876037626605568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789129341.252783:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789129341.253812:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:16223:x1876037626605568:12345-0@lo:503:mount.lustre.0 Request processed in 1682us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129341.253826:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000040:00080000:2.0:1789129341.254456:0:16223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789129341.254563:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789129341.254810:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.255208:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789129341.255284:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626605696 00000100:00100000:1.0:1789129341.255292:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626605696 00000100:00100000:1.0:1789129341.255554:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789129341.255569:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:16223:x1876037626605696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789129341.255966:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:16223:x1876037626605696:12345-0@lo:502:mount.lustre.0 Request processed in 400us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129341.255977:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789129341.256320:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789129341.256631:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789129341.256692:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789129341.256736:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789129341.256779:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789129341.256808:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789129341.256833:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789129341.256869:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789129341.256910:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789129341.256951:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789129341.256992:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789129341.257051:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.257082:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789129341.257339:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626605824 00000100:00100000:1.0:1789129341.257346:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626605824 00000100:00100000:1.0:1789129341.257381:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789129341.257390:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:16223:x1876037626605824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789129341.257573:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:16223:x1876037626605824:12345-0@lo:502:mount.lustre.0 Request processed in 184us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129341.257581:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789129341.257889:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789129341.257977:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789129341.257988:0:16223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1789129341.259259:0:16224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789129341.259276:0:16224:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789129341.259285:0:16224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789129341.259288:0:16224:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789129341.259296:0:16224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789129341.259316:0:16224:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90b382b6b490) 00000020:00000080:0.0:1789129341.259421:0:16224:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789129341.259429:0:16224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789129341.259527:0:16224:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b4bb015000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789129341.259539:0:16224:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789129341.259548:0:16224:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5c74554e47ce5568 00010000:00010000:0.0:1789129341.264214:0:16224:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789129341.265132:0:16224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789129341.268780:0:16224:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1789129341.271250:0:16224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789129341.271273:0:16224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129341.271282:0:16224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129341.271284:0:16224:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789129341.271288:0:16224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129341.271293:0:16224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129341.271295:0:16224:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789129341.271298:0:16224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789129341.271299:0:16224:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789129341.271304:0:16224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129341.271306:0:16224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129341.271308:0:16224:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789129341.271310:0:16224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789129341.271312:0:16224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129341.271314:0:16224:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789129341.271317:0:16224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789129341.271439:0:16224:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789129341.271443:0:16224:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789129341.271445:0:16224:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789129341.271449:0:16224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789129341.274782:0:16223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789129341.274850:0:16223:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789129341.274877:0:16223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce5553 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce555a expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.274891:0:16223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926ea600/0x5c74554e47ce5553 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce555a expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129341.274992:0:16223:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4bb015000 from 1 10000000:01000000:2.0:1789129341.274996:0:16223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789129341.275047:0:16223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129341.275061:0:16223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129341.275075:0:16223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129341.275101:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789129341.275188:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.275246:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789129341.275909:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626605952 00000100:00100000:0.0:1789129341.275919:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626605952 00000100:00100000:0.0:1789129341.275989:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789129341.276000:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:16223:x1876037626605952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789129341.276014:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129341.276033:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b490363600/0x5c74554e47ce5576 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce556f expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.276065:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490363600/0x5c74554e47ce5576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce556f expref: 18 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.276076:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b490363600/0x5c74554e47ce5576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce556f expref: 18 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.276085:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363600, rc 0) 00000100:00100000:0.0:1789129341.276151:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626605952:12345-0@lo:101:mount.lustre.0 Request processed in 152us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129341.276159:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789129341.276261:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626605952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789129341.276278:0:16223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129341.276288:0:16223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129341.277551:0:16223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789129341.278495:0:16223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789129341.279523:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789129341.279679:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789129341.279771:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789129341.279781:0:16223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789129341.279944:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789129341.280043:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.280089:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b486143d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789129341.280547:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626606080 00000100:00100000:1.0:1789129341.280557:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626606080 00000100:00100000:1.0:1789129341.280663:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789129341.280677:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626606080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789129341.281006:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5723c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626606080:12345-0@lo:501:mount.lustre.0 Request processed in 331us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129341.281016:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789129341.281121:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a78883c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789129341.281165:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789129341.281207:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129341.281237:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129341.281548:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626606208 00000100:00100000:1.0:1789129341.281553:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626606208 00000100:00100000:1.0:1789129341.281592:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789129341.281628:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626606208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789129341.282011:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626606208:12345-0@lo:503:mount.lustre.0 Request processed in 410us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129341.282019:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789129341.282127:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606208:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789129341.282982:0:16223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789129341.283102:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789129341.283180:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129341.283223:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129341.283587:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626606336 00000100:00100000:1.0:1789129341.283597:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626606336 00000100:00100000:1.0:1789129341.283774:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789129341.283788:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626606336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789129341.284071:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626606336:12345-0@lo:502:mount.lustre.0 Request processed in 286us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129341.284080:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789129341.284350:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789129341.284935:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789129341.284989:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789129341.285041:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789129341.285079:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789129341.285114:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789129341.285166:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789129341.285202:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789129341.285231:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:3.0:1789129341.285276:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:3.0:1789129341.285313:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:3.0:1789129341.285565:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:3.0:1789129341.287096:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789129341.287208:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129341.287263:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b485c7b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129341.287424:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626606464 00000100:00100000:0.0:1789129341.287437:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626606464 00000100:00100000:0.0:1789129341.287499:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789129341.287511:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626606464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789129341.287880:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626606464:12345-0@lo:502:mount.lustre.0 Request processed in 370us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129341.287888:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789129341.287918:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789129341.288064:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:3.0:1789129341.288080:0:16223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789129341.289228:0:16228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789129341.289244:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129341.289247:0:16228:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789129341.289255:0:16228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b4bb015000 00000020:00000080:3.0:1789129341.289257:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789129341.289265:0:16228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129341.289267:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129341.289268:0:16228:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789129341.289271:0:16228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789129341.289273:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129341.289274:0:16228:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789129341.289278:0:16228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90b4bb015000 00000020:00000080:3.0:1789129341.289280:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789129341.289403:0:16228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129341.289408:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129341.289410:0:16228:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789129341.289412:0:16228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789129341.289414:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129341.289415:0:16228:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789129341.289419:0:16228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b4bb015000 00000020:00000080:3.0:1789129341.289422:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789129341.290726:0:16228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129341.290735:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129341.290737:0:16228:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789129341.290740:0:16228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789129341.290744:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129341.290745:0:16228:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789129341.290751:0:16228:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90b4bb015000 00000020:00000080:3.0:1789129341.290753:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789129341.290837:0:16228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789129341.290855:0:16228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789129341.290857:0:16228:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789129341.290860:0:16228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789129341.294096:0:16223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789129341.294154:0:16223:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789129341.294219:0:16223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.294233:0:16223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129341.294283:0:16223:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789129341.294287:0:16223:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90b4bb015000 10000000:01000000:0.0:1789129341.294290:0:16223:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90b4bb015000 10000000:01000000:0.0:1789129341.294294:0:16223:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789129341.294300:0:16223:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90b4bb015000 from 1 10000000:01000000:0.0:1789129341.294303:0:16223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789129341.294338:0:16223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362400/0x5c74554e47ce557d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.294345:0:16223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b490362400/0x5c74554e47ce557d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.294355:0:16223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b490362400/0x5c74554e47ce557d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129341.294400:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789129341.294470:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.294506:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626606592 00000100:00100000:2.0:1789129341.294513:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626606592 00000100:00100000:0.0:1789129341.294518:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911300 going to sleep for 11 seconds 00000100:00100000:2.0:1789129341.294568:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789129341.294580:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626606592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789129341.294593:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129341.294632:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b4926eb000/0x5c74554e47ce5584 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce557d expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129341.294656:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b4926eb000/0x5c74554e47ce5584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce557d expref: 19 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129341.294668:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b4926eb000/0x5c74554e47ce5584 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce557d expref: 19 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129341.294677:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b4926eb000, rc 0) 00000100:00100000:2.0:1789129341.294731:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7759c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:16223:x1876037626606592:12345-0@lo:101:mount.lustre.0 Request processed in 154us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129341.294738:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789129341.295170:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789129341.295188:0:16223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b490362400/0x5c74554e47ce557d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5584 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129341.295198:0:16223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b490362400/0x5c74554e47ce557d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce5584 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789129341.295890:0:16223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789129341.297929:0:16223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789129341.300733:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789129341.300834:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789129341.300871:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789129341.300914:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789129341.300967:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789129341.302198:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789129341.302244:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789129341.302272:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789129341.302315:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789129341.302351:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789129341.303070:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789129341.303141:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789129341.303174:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789129341.303202:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789129341.303246:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789129341.303280:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789129341.303309:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789129341.303352:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789129341.304158:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789129341.304203:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789129341.304259:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789129341.304314:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789129341.304352:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789129341.304727:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789129341.304769:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789129341.304807:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789129341.304859:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789129341.304899:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789129341.304934:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789129341.305542:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1789129341.305590:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1789129341.305660:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1789129341.305706:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1789129341.305761:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1789129341.305802:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1789129341.305855:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1789129341.305895:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1789129341.307245:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1789129341.307267:0:16223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789129341.308154:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129341.308231:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129341.308278:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911300 going to sleep for 11 seconds 00000100:00100000:1.0:1789129341.308396:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626606720 00000100:00100000:1.0:1789129341.308404:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626606720 00000100:00100000:1.0:1789129341.308462:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789129341.308472:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:16223:x1876037626606720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789129341.308814:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:16223:x1876037626606720:12345-0@lo:501:mount.lustre.0 Request processed in 342us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129341.308823:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789129341.309365:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789129341.309426:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789129341.309472:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129341.309497:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911300 going to sleep for 11 seconds 00000100:00100000:1.0:1789129341.311097:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626606848 00000100:00100000:1.0:1789129341.311112:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626606848 00000100:00100000:1.0:1789129341.311174:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789129341.311185:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:16223:x1876037626606848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789129341.311926:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:16223:x1876037626606848:12345-0@lo:503:mount.lustre.0 Request processed in 738us (2449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129341.311938:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789129341.312256:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789129341.314191:0:16223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789129341.314322:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789129341.314592:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129341.314861:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c1911300 going to sleep for 11 seconds 00000100:00100000:2.0:1789129341.316200:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626606976 00000100:00100000:2.0:1789129341.316215:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626606976 00000100:00100000:2.0:1789129341.316276:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789129341.316286:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:16223:x1876037626606976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789129341.317934:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7759050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:16223:x1876037626606976:12345-0@lo:502:mount.lustre.0 Request processed in 1635us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129341.317953:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789129341.318066:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626606976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789129341.319981:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789129341.320088:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789129341.320125:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789129341.320173:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789129341.320234:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789129341.320289:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789129341.320327:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789129341.322251:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789129341.322408:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789129341.322451:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789129341.322483:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789129341.322530:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789129341.322564:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789129341.322595:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789129341.323533:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789129341.323574:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789129341.323756:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789129341.323813:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789129341.323850:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789129341.323882:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789129341.323950:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789129341.323988:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789129341.324022:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789129341.324069:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789129341.324103:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789129341.324134:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789129341.324179:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789129341.324212:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789129341.324243:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789129341.324284:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789129341.324313:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789129341.325486:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789129341.325554:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789129341.325688:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789129341.325740:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789129341.325788:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789129341.325843:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789129341.325883:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789129341.325926:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789129341.325956:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789129341.326015:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a7888b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626607104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789129341.326108:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.326207:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4883fce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789129341.329193:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626607104 00000100:00100000:1.0:1789129341.329216:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626607104 00000100:00100000:1.0:1789129341.329291:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789129341.329304:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:16223:x1876037626607104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789129341.330176:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7759450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:16223:x1876037626607104:12345-0@lo:502:mount.lustre.0 Request processed in 869us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129341.330189:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789129341.330877:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a7888b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626607104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789129341.331021:0:16223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789129341.331041:0:16223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789129341.338891:0:16234:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789129341.338908:0:16234:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90b382b6ced8) 00000020:00000080:0.0:1789129341.339256:0:16234:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789129341.339380:0:16234:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90b4bb015000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789129341.339385:0:16234:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90b4bb015000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789129341.339393:0:16234:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90b4bb015000 3 00010000:00080000:0.0:1789129341.339431:0:16234:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90b3828f2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.139@tcp at head 00010000:00010000:0.0:1789129341.341107:0:16234:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789129341.341350:0:16234:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789129341.341396:0:16234:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789129341.341412:0:16234:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5c74554e47ce5592 00000100:00080000:0.0:1789129341.341426:0:16234:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789129341.341434:0:16234:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90b3828f2800 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789129341.341500:0:16234:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b383cac3c0 x1876037626607232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789129341.341526:0:16234:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789129341.341589:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789129341.341593:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789129341.341596:0:38:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789129341.341600:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 502 00000100:00080000:0.0:1789129341.341624:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789129341.341629:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b485d09000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:0.0:1789129341.341644:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b383cade00 x1876037626607488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:2.0:1789129341.343286:0:16234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789129341.343511:0:16223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789129341.343538:0:16223:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789129341.343563:0:16223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362400/0x5c74554e47ce557d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5584 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.343575:0:16223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b490362400/0x5c74554e47ce557d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5584 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789129341.343643:0:16223:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789129341.343657:0:16223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789129341.343658:0:16223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789129341.343659:0:16223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789129341.343660:0:16223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789129341.343661:0:16223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789129341.343663:0:16223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789129341.343665:0:16223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:2.0:1789129341.343666:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626607360:0@lo:400:kworker.0 00000020:01000004:1.0:1789129341.343667:0:16223:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789129341.343671:0:16223:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789129341.343678:0:16223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789129341.343679:0:16223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789129341.343680:0:16223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789129341.343681:0:16223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789129341.343682:0:16223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789129341.343682:0:16223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789129341.343683:0:16223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789129341.343684:0:16223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789129341.343685:0:16223:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789129341.343719:0:16223:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789129341.343732:0:16223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626607872:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789129341.343753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129341.343768:0:16223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.343799:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789129341.343807:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626607616:0@lo:400:kworker.0 00000100:00100000:3.0:1789129341.343853:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626607744:0@lo:400:kworker.0 00000100:00100000:0.0:1789129341.343888:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626607360 00000100:00100000:0.0:1789129341.343896:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626607360 00000100:00100000:0.0:1789129341.343953:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789129341.343962:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7888b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626607360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129341.347101:0:16223:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4c19110c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129341.359900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.359980:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626607232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789129341.360032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.360062:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626607488:0@lo:8:kworker.0 00000100:00100000:2.0:1789129341.360089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129341.360144:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626607872 00000100:00100000:2.0:1789129341.360152:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626607872 00000100:00100000:2.0:1789129341.360206:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789129341.360215:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:16223:x1876037626607872:12345-0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789129341.360243:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:2.0:1789129341.360264:0:14809:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789129341.360279:0:14809:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1789129341.360284:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129341.360297:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626607616 00000100:00100000:3.0:1789129341.360301:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626607616 00000100:00100000:3.0:1789129341.360321:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626607232 00000100:00100000:3.0:1789129341.360323:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626607232 00000100:00100000:3.0:1789129341.360331:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626607744 00000100:00100000:3.0:1789129341.360333:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626607744 00000100:00100000:3.0:1789129341.360356:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789129341.360362:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7888f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626607616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129341.360420:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7888f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626607616:12345-0@lo:400:kworker.0 Request processed in 59us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129341.360429:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789129341.360444:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789129341.360449:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626607744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129341.360480:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626607744:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129341.360485:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789129341.360496:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789129341.360500:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7888780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876037626607232:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789129341.360517:0:14817:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:3.0:1789129341.360555:0:14817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5c74554e47ce5599 00000004:00100000:3.0:1789129341.360569:0:14817:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789129341.360621:0:14817:0:(import.c:65:import_set_state_nolock()) ffff90b485293000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789129341.360807:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7888780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876037626607232:12345-0@lo:38:llog_process_th.0 Request processed in 304us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129341.360814:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789129341.360830:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789129341.360857:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b383cac3c0 x1876037626607232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789129351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129341.360867:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789129341.360874:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789129341.360882:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789129341.360886:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789129341.360888:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b3828f2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789129341.360894:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876037626607232:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789129341.360974:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b383cafc00 x1876037626607616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129341.360996:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626607616:0@lo:400:kworker.0 00010000:00080000:3.0:1789129341.361302:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90b383cad680 x1876037626607744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789129341.361313:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626607744:0@lo:400:kworker.0 00000100:00100000:0.0:1789129341.362107:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7888b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626607360:12345-0@lo:400:kworker.0 Request processed in 18137us (18344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129341.362120:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789129341.362143:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626607488 00000100:00100000:0.0:1789129341.362158:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626607488 00000100:00100000:0.0:1789129341.362184:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789129341.362190:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876037626607488:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789129341.362259:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876037626607488:12345-0@lo:8:kworker.0 Request processed in 68us (2168us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789129341.362265:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789129341.362818:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626607360:0@lo:400:kworker.0 00000100:00100000:3.0:1789129341.363152:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789129341.363160:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789129341.363164:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789129341.363166:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626607488:0@lo:8:kworker.0 20000000:01000000:3.0:1789129341.401011:0:14809:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789129341.401035:0:14809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789129341.401100:0:14832:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789129341.401106:0:14832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789129341.401131:0:14832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.401152:0:14832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce5473 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce546c expref: 19 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.401161:0:14832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.401203:0:14832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce5473 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce546c expref: 19 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.401226:0:14832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce5473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce546c expref: 19 pid: 14811 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129341.401241:0:14832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14832:1876037626608000:0@lo:104: 00000100:00100000:1.0:1789129341.401308:0:14832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129341.401359:0:14832:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4bac29540 going to sleep for 11 seconds 00000100:00100000:3.0:1789129341.402109:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626608000 00000100:00100000:3.0:1789129341.402118:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626608000 00000100:00100000:3.0:1789129341.402169:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789129341.402178:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bfd76cf-bae1-432b-b8fe-46974cf010df+3:14832:x1876037626608000:12345-0@lo:104: 00010000:00010000:3.0:1789129341.402203:0:14800:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129341.402271:0:14800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789129341.402277:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bfd76cf-bae1-432b-b8fe-46974cf010df+3:14832:x1876037626608000:12345-0@lo:104: Request processed in 101us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129341.402285:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789129341.402643:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129341.402661:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.402670:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58dbe00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129341.402674:0:14805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.402682:0:14805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789129341.402690:0:14805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129341.402708:0:14805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789129341.402800:0:14805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.402807:0:14805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789129341.402834:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.402841:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4b58dbe00/0x5c74554e47ce546c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce5473 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.402865:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129341.402868:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129341.402869:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129341.402880:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129341.402901:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626608128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129341.402955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129341.403031:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626608128 00000100:00100000:1.0:1789129341.403036:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626608128 00010000:00010000:1.0:1789129341.403061:0:14802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce5473 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce546c expref: 20 pid: 14811 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129341.403090:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789129341.403098:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bfd76cf-bae1-432b-b8fe-46974cf010df+20:3308:x1876037626608128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789129341.403112:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129341.403118:0:14802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce5473 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce546c expref: 20 pid: 14811 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403145:0:14802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce5473 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce546c expref: 20 pid: 14811 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403169:0:14802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403179:0:14802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789129341.403199:0:14802:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002132807s 00010000:00010000:1.0:1789129341.403205:0:14802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403214:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403221:0:14802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403229:0:14802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403245:0:14802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129341.403249:0:14802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403257:0:14802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403267:0:14802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403280:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129341.403318:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bfd76cf-bae1-432b-b8fe-46974cf010df+20:3308:x1876037626608128:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129341.403327:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789129341.403382:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626608128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789129341.403428:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926eb600/0x5c74554e47ce5473 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce546c expref: 19 pid: 14811 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129341.403440:0:14832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14832:1876037626608000:0@lo:104: 00010000:00010000:1.0:1789129341.403456:0:14832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403466:0:14832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403472:0:14832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129341.403490:0:14832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480030c00/0x5c74554e47ce55a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129341.407476:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:16223:x1876037626607872:12345-0@lo:253:mount.lustre.0 Request processed in 47249us (63693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129341.407494:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789129341.407594:0:16223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bfd76cf-bae1-432b-b8fe-46974cf010df:16223:1876037626607872:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789129341.407716:0:16223:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789129341.407721:0:16223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789129341.407723:0:16223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789129341.407725:0:16223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789129341.407726:0:16223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789129341.407727:0:16223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789129341.407729:0:16223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789129341.407731:0:16223:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789129341.407733:0:16223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789129341.407734:0:16223:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789129341.407754:0:16223:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789129341.410361:0:16223:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789129341.410521:0:16223:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789129341.411156:0:16223:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789129341.411333:0:16223:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789129341.411498:0:16223:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1789129341.411635:0:16223:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789129341.412592:0:16223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789129341.493120:0:16223:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789129341.493131:0:16223:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789129341.493175:0:16223:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789129341.493249:0:16223:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.139@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789129341.493268:0:16223:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789129341.493300:0:16223:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789129341.958010:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129342.985838:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789129343.373065:0:14813:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789129343.373074:0:14813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90b49bdce800 from 8 10000000:01000000:2.0:1789129343.373080:0:14813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789129343.373145:0:14813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce55a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129343.373157:0:14813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce55a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129343.373168:0:14813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce55a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129343.373198:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626608256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789129343.373278:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129343.373482:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c34e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789129343.373540:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626608256 00000100:00100000:3.0:1789129343.373549:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626608256 00000100:00100000:3.0:1789129343.373644:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789129343.373656:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:14813:x1876037626608256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129343.373687:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129343.373703:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce55ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce55a7 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129343.373727:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce55ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce55a7 expref: 19 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129343.373738:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf2000/0x5c74554e47ce55ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce55a7 expref: 19 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129343.373749:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2000, rc 0) 00000100:00100000:3.0:1789129343.373796:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:14813:x1876037626608256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129343.373803:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789129343.374043:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626608256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129343.374059:0:14813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce55a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce55ae expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129343.374068:0:14813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce55a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce55ae expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129343.374223:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626608384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789129343.374271:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129343.374889:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b489c34e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789129343.374975:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626608384 00000100:00100000:3.0:1789129343.374983:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626608384 00000100:00100000:3.0:1789129343.375035:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789129343.375044:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:14813:x1876037626608384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789129343.375074:0:14809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789129343.375094:0:14809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789129343.375097:0:14809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789129343.375391:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7758850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:14813:x1876037626608384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 347us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129343.375399:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789129343.375477:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626608384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789129343.375551:0:14813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789129343.375561:0:14813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce55a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce55ae expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129343.375571:0:14813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b4926eac00/0x5c74554e47ce55a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce55ae expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129344.007200:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129344.774795:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626608512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129344.774887:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129344.775000:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626608512 00000100:00100000:3.0:1789129344.775008:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626608512 00000100:00100000:3.0:1789129344.775070:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789129344.775082:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626608512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129344.775130:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129344.775187:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626608512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129344.775195:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789129344.775222:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129344.775268:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626608512:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789129345.034097:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129346.054951:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789129346.759383:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789129346.825874:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789129346.825888:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789129346.825892:0:8:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789129346.825905:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90b485d09000 using connection 192.168.201.139@tcp/0@lo 00000100:00100000:1.0:1789129346.825942:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90b4bae78000 x1876037626608896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789129346.825998:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626608768:0@lo:400:kworker.0 00000100:00100000:1.0:1789129346.826073:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129346.826145:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789129346.826151:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626609024:0@lo:400:kworker.0 00000100:00100000:1.0:1789129346.826176:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129346.826208:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626608768 00000100:00100000:1.0:1789129346.826216:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626608768 00000100:00100000:1.0:1789129346.826273:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789129346.826281:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626608768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129346.826329:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626608768:12345-0@lo:400:kworker.0 Request processed in 48us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129346.826335:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789129346.826382:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626608768:0@lo:400:kworker.0 00000100:00100000:3.0:1789129346.826844:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bfd76cf-bae1-432b-b8fe-46974cf010df:3307:1876037626608640:0@lo:400:kworker.0 00000100:00100000:3.0:1789129346.826889:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129346.826936:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626609280:0@lo:400:kworker.0 00000100:00100000:3.0:1789129346.826961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129346.826983:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789129346.826989:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626609152:0@lo:400:kworker.0 00000100:00100000:3.0:1789129346.827010:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129346.827055:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626608896:0@lo:8:kworker.0 00000100:00100000:3.0:1789129346.827081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129346.827110:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626609024 00000100:00100000:3.0:1789129346.827115:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626609024 00000100:00100000:3.0:1789129346.827140:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626609280 00000100:00100000:3.0:1789129346.827143:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626609280 00000100:00100000:3.0:1789129346.827157:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626609152 00000100:00100000:3.0:1789129346.827159:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626609152 00000100:00100000:3.0:1789129346.827173:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789129346.827180:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626609024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129346.827222:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626609024:12345-0@lo:400:kworker.0 Request processed in 42us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129346.827229:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789129346.827242:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789129346.827249:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626609280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129346.827278:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626609280:12345-0@lo:400:kworker.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129346.827284:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789129346.827293:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789129346.827299:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626609152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129346.827323:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626609152:12345-0@lo:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129346.827328:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789129346.827343:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789129346.827349:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129346.827362:0:15505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626608896 00000100:00100000:3.0:1789129346.827365:0:15505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626608896 00000100:00100000:3.0:1789129346.827383:0:15505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789129346.827395:0:15505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876037626608896:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789129346.827420:0:15505:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:3.0:1789129346.827458:0:15505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5c74554e47ce55b5 00002000:00100000:3.0:1789129346.827473:0:15505:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90b485296800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113985 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789129346.827477:0:15505:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789129346.827480:0:15505:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789129346.828255:0:15505:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789129346.828285:0:15505:0:(import.c:65:import_set_state_nolock()) ffff90b485294800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789129346.828352:0:15505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876037626608896:12345-0@lo:8:kworker.0 Request processed in 956us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129346.828360:0:15505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789129346.828409:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bae78000 x1876037626608896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789129371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789129346.828423:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789129346.828434:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789129346.828441:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789129346.828444:0:3305:0:(import.c:65:import_set_state_nolock()) ffff90b485d09000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789129346.828469:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789129346.828474:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876037626608896:0@lo:8:kworker.0 00000004:00080000:3.0:1789129346.828532:0:14841:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1789129346.828550:0:14841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48a171e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14841:1876037626609536:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789129346.828580:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129346.828753:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626608640 00000100:00100000:2.0:1789129346.828760:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626608640 00000100:00100000:2.0:1789129346.828794:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789129346.828802:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3307:x1876037626608640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129346.828838:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3307:x1876037626608640:12345-0@lo:400:kworker.0 Request processed in 37us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129346.828844:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1789129346.829073:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bae79e00 x1876037626609152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129346.829084:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626609152:0@lo:400:kworker.0 00000100:00100000:2.0:1789129346.829095:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bfd76cf-bae1-432b-b8fe-46974cf010df:3307:1876037626608640:0@lo:400:kworker.0 00010000:00080000:2.0:1789129346.829105:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bae7a580 x1876037626609280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129346.829115:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626609280:0@lo:400:kworker.0 00000100:00100000:2.0:1789129346.829157:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bacd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626609408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129346.829186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789129346.829215:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bae78f00 x1876037626609024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129346.829224:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626609024:0@lo:400:kworker.0 00000100:00100000:2.0:1789129346.829251:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626609408 00000100:00100000:2.0:1789129346.829255:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626609408 00000100:00100000:2.0:1789129346.829291:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789129346.829298:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626609408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129346.829322:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129346.829358:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876037626609408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129346.829365:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789129346.829384:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789129346.829400:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b4bacd30c0 x1876037626609408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789129362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129346.829415:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bacd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626609408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789129346.829439:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626609536 00000100:00100000:2.0:1789129346.829443:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626609536 00000100:00100000:2.0:1789129346.829466:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789129346.829473:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14841:x1876037626609536:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789129346.829840:0:14840:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789129346.830305:0:14840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 509927701928ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789129346.831767:0:14841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b484e32240 going to sleep for 11 seconds 00002000:00080000:2.0:1789129346.854237:0:15504:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789129346.854250:0:15504:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789129346.854256:0:15504:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1789129346.887513:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.887536:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce55bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.887554:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.887560:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.887566:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce55bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.887584:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce55bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.887595:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce55bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.887656:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce55bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.887676:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789129346.888150:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.888156:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002135b8da/0x5c74554e47ce55c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.888165:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.888168:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.888172:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002135b8da/0x5c74554e47ce55c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.888182:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002135b8da/0x5c74554e47ce55c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.888197:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002135b8da/0x5c74554e47ce55c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.888204:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002135b8da/0x5c74554e47ce55c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.888222:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789129346.888666:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.888673:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce55ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.888681:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.888685:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.888689:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce55ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.888698:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce55ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.888706:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce55ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.888713:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce55ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.888733:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789129346.889118:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.889124:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce55d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.889133:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.889135:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.889140:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce55d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.889149:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce55d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.889156:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce55d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.889163:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce55d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.889172:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1789129346.889560:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.889566:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827d5b01/0x5c74554e47ce55d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.889574:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.889583:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.889587:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827d5b01/0x5c74554e47ce55d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.889596:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000827d5b01/0x5c74554e47ce55d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.889653:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827d5b01/0x5c74554e47ce55d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.889663:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000827d5b01/0x5c74554e47ce55d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.889671:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1789129346.890045:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.890051:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce55df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.890059:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.890062:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.890065:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce55df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.890074:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce55df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.890083:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce55df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.890096:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce55df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.890103:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1789129346.890558:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.890564:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022d39f0d/0x5c74554e47ce55e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.890573:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.890576:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.890580:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022d39f0d/0x5c74554e47ce55e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.890590:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022d39f0d/0x5c74554e47ce55e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.891068:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022d39f0d/0x5c74554e47ce55e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.891080:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022d39f0d/0x5c74554e47ce55e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.891091:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1789129346.891550:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.891557:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbae306f/0x5c74554e47ce55ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.891573:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.891576:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.891582:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbae306f/0x5c74554e47ce55ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.891592:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbae306f/0x5c74554e47ce55ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.891633:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbae306f/0x5c74554e47ce55ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.891640:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbae306f/0x5c74554e47ce55ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.891649:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1789129346.892034:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.892040:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3637bbc/0x5c74554e47ce55f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.892048:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.892051:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.892055:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3637bbc/0x5c74554e47ce55f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.892065:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3637bbc/0x5c74554e47ce55f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.892085:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3637bbc/0x5c74554e47ce55f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.892092:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3637bbc/0x5c74554e47ce55f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.892101:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1789129346.892503:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.892509:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1399463/0x5c74554e47ce55fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.892518:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.892521:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.892526:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1399463/0x5c74554e47ce55fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.892536:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1399463/0x5c74554e47ce55fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.892544:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1399463/0x5c74554e47ce55fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.892551:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1399463/0x5c74554e47ce55fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.892572:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:1.0:1789129346.899854:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1789129346.899869:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce55bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.899885:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.899891:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce55bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.899920:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce55bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.899951:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce55bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.899958:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034cf15be/0x5c74554e47ce55bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.899985:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1789129346.899989:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002135b8da/0x5c74554e47ce55c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.899995:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.899997:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002135b8da/0x5c74554e47ce55c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900005:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002135b8da/0x5c74554e47ce55c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900016:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002135b8da/0x5c74554e47ce55c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900022:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002135b8da/0x5c74554e47ce55c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900044:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1789129346.900048:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce55ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900054:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ebc00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.900056:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce55ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900064:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce55ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900074:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce55ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900081:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090f47f3f/0x5c74554e47ce55ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900093:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789129346.900097:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce55d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900103:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.900106:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce55d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900124:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce55d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900135:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce55d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900142:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945811e0/0x5c74554e47ce55d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900157:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789129346.900162:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000827d5b01/0x5c74554e47ce55d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900169:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eb600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.900172:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000827d5b01/0x5c74554e47ce55d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900180:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000827d5b01/0x5c74554e47ce55d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900189:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000827d5b01/0x5c74554e47ce55d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900198:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000827d5b01/0x5c74554e47ce55d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900222:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789129346.900226:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce55df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900232:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926ea000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.900235:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce55df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900245:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce55df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900255:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce55df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900263:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042208b73/0x5c74554e47ce55df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900275:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789129346.900280:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022d39f0d/0x5c74554e47ce55e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900287:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.900290:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022d39f0d/0x5c74554e47ce55e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900307:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022d39f0d/0x5c74554e47ce55e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900317:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022d39f0d/0x5c74554e47ce55e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900323:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022d39f0d/0x5c74554e47ce55e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900339:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789129346.900343:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbae306f/0x5c74554e47ce55ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900350:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ba00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.900352:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbae306f/0x5c74554e47ce55ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900360:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbae306f/0x5c74554e47ce55ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900368:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbae306f/0x5c74554e47ce55ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900374:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbae306f/0x5c74554e47ce55ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900399:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789129346.900403:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3637bbc/0x5c74554e47ce55f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900410:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.900414:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3637bbc/0x5c74554e47ce55f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900422:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3637bbc/0x5c74554e47ce55f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900433:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3637bbc/0x5c74554e47ce55f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.900440:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3637bbc/0x5c74554e47ce55f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.901770:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129346.901781:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1399463/0x5c74554e47ce55fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.901792:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151bc00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.901796:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1399463/0x5c74554e47ce55fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.901818:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1399463/0x5c74554e47ce55fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.901834:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1399463/0x5c74554e47ce55fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.901841:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1399463/0x5c74554e47ce55fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.901862:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129346.901864:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129346.901866:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789129346.902928:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.902940:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db36463/0x5c74554e47ce5602 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.902955:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1789129346.902960:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.902967:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003db36463/0x5c74554e47ce5602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.902980:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003db36463/0x5c74554e47ce5602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.902990:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db36463/0x5c74554e47ce5602 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.902998:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003db36463/0x5c74554e47ce5602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.903021:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789129346.903574:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129346.903581:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003db36463/0x5c74554e47ce5602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.903590:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:1.0:1789129346.903594:0:14805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003db36463/0x5c74554e47ce5602 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.903696:0:14805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003db36463/0x5c74554e47ce5602 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.903711:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003db36463/0x5c74554e47ce5602 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.903728:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003db36463/0x5c74554e47ce5602 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129346.903745:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129346.903747:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129346.903748:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789129346.906194:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.906208:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412b531b/0x5c74554e47ce5609 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.906225:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.906236:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.906243:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000412b531b/0x5c74554e47ce5609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.906263:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000412b531b/0x5c74554e47ce5609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.906274:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000412b531b/0x5c74554e47ce5609 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.906281:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000412b531b/0x5c74554e47ce5609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.906307:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789129346.910788:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.910802:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b45c3bcc/0x5c74554e47ce5610 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.910822:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.910827:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.910834:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b45c3bcc/0x5c74554e47ce5610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.910851:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b45c3bcc/0x5c74554e47ce5610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.910863:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b45c3bcc/0x5c74554e47ce5610 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.910878:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b45c3bcc/0x5c74554e47ce5610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.910890:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789129346.911385:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.911392:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035e4eb03/0x5c74554e47ce5617 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.911402:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.911405:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.911409:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035e4eb03/0x5c74554e47ce5617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.911419:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035e4eb03/0x5c74554e47ce5617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.911427:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035e4eb03/0x5c74554e47ce5617 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.911434:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035e4eb03/0x5c74554e47ce5617 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.911443:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789129346.912374:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.912382:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e707cda4/0x5c74554e47ce561e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.912398:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.912401:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.912406:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e707cda4/0x5c74554e47ce561e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.912416:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e707cda4/0x5c74554e47ce561e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.912424:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e707cda4/0x5c74554e47ce561e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.912430:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e707cda4/0x5c74554e47ce561e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.912437:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1789129346.913193:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.913202:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce5625 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.913213:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.913216:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.913221:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce5625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.913230:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce5625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.913250:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce5625 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.913257:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce5625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.913265:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1789129346.915871:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.915885:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054ca5242/0x5c74554e47ce562c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.915902:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.915907:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.915914:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054ca5242/0x5c74554e47ce562c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.915927:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054ca5242/0x5c74554e47ce562c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.915938:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054ca5242/0x5c74554e47ce562c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.915945:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054ca5242/0x5c74554e47ce562c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.915967:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1789129346.916393:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.916398:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032578e11/0x5c74554e47ce5633 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.916407:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.916410:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.916415:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032578e11/0x5c74554e47ce5633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.916425:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032578e11/0x5c74554e47ce5633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.916433:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032578e11/0x5c74554e47ce5633 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.916440:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032578e11/0x5c74554e47ce5633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.916449:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1789129346.917468:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.917478:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043885b5/0x5c74554e47ce563a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.917489:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.917498:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.917503:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000043885b5/0x5c74554e47ce563a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.917515:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000043885b5/0x5c74554e47ce563a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.917524:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043885b5/0x5c74554e47ce563a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.917531:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000043885b5/0x5c74554e47ce563a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.917540:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1789129346.918169:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.918178:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f710133b/0x5c74554e47ce5641 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.918187:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.918190:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.918195:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f710133b/0x5c74554e47ce5641 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.918204:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f710133b/0x5c74554e47ce5641 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.918212:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f710133b/0x5c74554e47ce5641 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.918227:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f710133b/0x5c74554e47ce5641 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.918237:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1789129346.921029:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.921047:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a83250/0x5c74554e47ce5648 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.921064:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.921068:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.921075:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052a83250/0x5c74554e47ce5648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.921089:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052a83250/0x5c74554e47ce5648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.921099:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052a83250/0x5c74554e47ce5648 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.921107:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052a83250/0x5c74554e47ce5648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.921117:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1789129346.922041:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.922050:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e612256/0x5c74554e47ce564f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.922066:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.922069:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.922074:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e612256/0x5c74554e47ce564f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.922085:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e612256/0x5c74554e47ce564f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.922094:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e612256/0x5c74554e47ce564f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.922101:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e612256/0x5c74554e47ce564f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.922110:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1789129346.922575:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.922581:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47ed241/0x5c74554e47ce5656 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.922588:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.922591:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.922595:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d47ed241/0x5c74554e47ce5656 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.922877:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d47ed241/0x5c74554e47ce5656 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.922897:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d47ed241/0x5c74554e47ce5656 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.922904:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d47ed241/0x5c74554e47ce5656 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.922914:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1789129346.923954:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.923964:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce565d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.923975:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.923978:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.923983:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce565d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.923993:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce565d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.924001:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce565d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.924009:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce565d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.924032:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1789129346.924826:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.924834:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce5664 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.924845:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.924848:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.924853:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce5664 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.924862:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce5664 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.924870:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce5664 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.924877:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce5664 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.924887:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1789129346.925271:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.925276:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e68d0d43/0x5c74554e47ce566b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.925284:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.925292:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.925296:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e68d0d43/0x5c74554e47ce566b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.925305:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e68d0d43/0x5c74554e47ce566b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.925312:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e68d0d43/0x5c74554e47ce566b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.926469:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e68d0d43/0x5c74554e47ce566b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.926484:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1789129346.928285:0:15504:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789129346.928300:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d7b1ed6/0x5c74554e47ce5672 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.929093:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1789129346.929100:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129346.929109:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d7b1ed6/0x5c74554e47ce5672 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.929125:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d7b1ed6/0x5c74554e47ce5672 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.929137:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d7b1ed6/0x5c74554e47ce5672 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.929154:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d7b1ed6/0x5c74554e47ce5672 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.929169:0:15504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00080000:2.0:1789129346.929805:0:15504:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1789129346.929986:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a172d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14841:x1876037626609536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 100509us (101401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129346.929997:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789129346.930039:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:2.0:1789129346.930046:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000412b531b/0x5c74554e47ce5609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930055:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.930059:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000412b531b/0x5c74554e47ce5609 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930069:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000412b531b/0x5c74554e47ce5609 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930086:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000412b531b/0x5c74554e47ce5609 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930092:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000412b531b/0x5c74554e47ce5609 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930127:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1789129346.930131:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b45c3bcc/0x5c74554e47ce5610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930137:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151ac00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.930140:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b45c3bcc/0x5c74554e47ce5610 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930148:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b45c3bcc/0x5c74554e47ce5610 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930157:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b45c3bcc/0x5c74554e47ce5610 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930164:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b45c3bcc/0x5c74554e47ce5610 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930192:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1789129346.930210:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035e4eb03/0x5c74554e47ce5617 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930216:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.930220:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035e4eb03/0x5c74554e47ce5617 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930252:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035e4eb03/0x5c74554e47ce5617 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930276:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035e4eb03/0x5c74554e47ce5617 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930284:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035e4eb03/0x5c74554e47ce5617 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930310:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1789129346.930314:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e707cda4/0x5c74554e47ce561e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930343:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151b400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.930346:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e707cda4/0x5c74554e47ce561e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930354:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e707cda4/0x5c74554e47ce561e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930364:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e707cda4/0x5c74554e47ce561e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930819:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e707cda4/0x5c74554e47ce561e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930850:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1789129346.930855:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce5625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930861:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b48151a000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.930865:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce5625 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930873:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce5625 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930885:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce5625 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930892:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ea5cecc/0x5c74554e47ce5625 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930905:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1789129346.930909:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054ca5242/0x5c74554e47ce562c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930916:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285bc00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.930919:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054ca5242/0x5c74554e47ce562c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930939:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054ca5242/0x5c74554e47ce562c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930950:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054ca5242/0x5c74554e47ce562c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930957:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054ca5242/0x5c74554e47ce562c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930970:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1789129346.930974:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032578e11/0x5c74554e47ce5633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930980:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285ac00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.930983:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032578e11/0x5c74554e47ce5633 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930990:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032578e11/0x5c74554e47ce5633 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.930998:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032578e11/0x5c74554e47ce5633 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931005:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032578e11/0x5c74554e47ce5633 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931026:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1789129346.931029:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000043885b5/0x5c74554e47ce563a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931035:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.931037:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000043885b5/0x5c74554e47ce563a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931045:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000043885b5/0x5c74554e47ce563a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931055:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000043885b5/0x5c74554e47ce563a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931062:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000043885b5/0x5c74554e47ce563a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931073:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789129346.931076:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f710133b/0x5c74554e47ce5641 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931082:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.931085:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f710133b/0x5c74554e47ce5641 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931103:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f710133b/0x5c74554e47ce5641 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931113:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f710133b/0x5c74554e47ce5641 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931120:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f710133b/0x5c74554e47ce5641 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931133:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789129346.931137:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052a83250/0x5c74554e47ce5648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931144:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.931148:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a83250/0x5c74554e47ce5648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931155:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052a83250/0x5c74554e47ce5648 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931164:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052a83250/0x5c74554e47ce5648 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931171:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052a83250/0x5c74554e47ce5648 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931195:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789129346.931200:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e612256/0x5c74554e47ce564f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931206:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285b600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.931209:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e612256/0x5c74554e47ce564f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931216:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e612256/0x5c74554e47ce564f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931225:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e612256/0x5c74554e47ce564f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931232:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e612256/0x5c74554e47ce564f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931244:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789129346.931248:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d47ed241/0x5c74554e47ce5656 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931254:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285b200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.931257:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47ed241/0x5c74554e47ce5656 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931277:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d47ed241/0x5c74554e47ce5656 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931287:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d47ed241/0x5c74554e47ce5656 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931295:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d47ed241/0x5c74554e47ce5656 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931310:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789129346.931313:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce565d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931744:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285b000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.931748:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce565d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931757:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce565d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931769:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce565d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931776:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce565d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931803:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789129346.931807:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce5664 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931814:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.931817:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce5664 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931825:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce5664 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931836:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce5664 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931843:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce5664 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931856:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789129346.931861:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e68d0d43/0x5c74554e47ce566b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931867:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.931870:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e68d0d43/0x5c74554e47ce566b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931889:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e68d0d43/0x5c74554e47ce566b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931899:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e68d0d43/0x5c74554e47ce566b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931907:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e68d0d43/0x5c74554e47ce566b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931952:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129346.931957:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d7b1ed6/0x5c74554e47ce5672 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931963:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285ae00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129346.931966:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d7b1ed6/0x5c74554e47ce5672 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931974:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d7b1ed6/0x5c74554e47ce5672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.931983:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d7b1ed6/0x5c74554e47ce5672 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.932018:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d7b1ed6/0x5c74554e47ce5672 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129346.932042:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129346.932043:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129346.932045:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129346.932121:0:14841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48a171e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14841:1876037626609536:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789129346.932137:0:14841:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789129346.932195:0:14841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14841:1876037626609664:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789129346.932294:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129346.933341:0:14841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b48312dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789129346.933526:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626609664 00000100:00100000:2.0:1789129346.933535:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626609664 00000100:00100000:2.0:1789129346.933781:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789129346.933793:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a78892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14841:x1876037626609664:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789129346.933871:0:15506:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1789129346.941666:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129346.958388:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a78892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14841:x1876037626609664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 24583us (26078us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789129346.958408:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789129346.960657:0:14841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788a580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14841:1876037626609664:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789129346.960677:0:14841:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1789129346.970155:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789129347.079073:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129348.101829:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129349.144841:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789129349.808295:0:16585:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg139-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789129349.894806:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b48a171e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626609792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129349.894892:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129349.895005:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626609792 00000100:00100000:3.0:1789129349.895013:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626609792 00000100:00100000:3.0:1789129349.895080:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789129349.895090:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626609792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129349.895125:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129349.895171:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626609792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129349.895178:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789129349.895231:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129349.895266:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b48a171e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626609792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789129350.150818:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129351.174162:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129351.942634:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626610176:0@lo:400:kworker.0 00000100:00100000:0.0:1789129351.942732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129351.942794:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789129351.942800:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626610304:0@lo:400:kworker.0 00000100:00100000:0.0:1789129351.942827:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129351.942860:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626610304 00000100:00100000:0.0:1789129351.942869:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626610304 00000100:00100000:0.0:1789129351.942939:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789129351.942950:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626610304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129351.943012:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626610304:12345-0@lo:400:kworker.0 Request processed in 63us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129351.943020:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789129351.943068:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b383cac3c0 x1876037626610304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789129351.943106:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626610304:0@lo:400:kworker.0 00000100:00100000:2.0:1789129351.944474:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626610048:0@lo:400:kworker.0 00000100:00100000:2.0:1789129351.944550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129351.944585:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626610560:0@lo:400:kworker.0 00000100:00100000:2.0:1789129351.944636:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129351.944662:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789129351.944669:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bfd76cf-bae1-432b-b8fe-46974cf010df:3307:1876037626609920:0@lo:400:kworker.0 00000100:00100000:2.0:1789129351.944697:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129351.944723:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626610432:0@lo:400:kworker.0 00000100:00100000:2.0:1789129351.944743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129351.944786:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626610176 00000100:00100000:2.0:1789129351.944793:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626610176 00000100:00100000:2.0:1789129351.944849:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626610048 00000100:00100000:2.0:1789129351.944853:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626610048 00000100:00100000:2.0:1789129351.944872:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789129351.944881:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383caf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626610176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129351.945082:0:15505:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789129351.945092:0:15505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789129351.945647:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789129351.945662:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bfcd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626610688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129351.945709:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129351.945748:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626610688 00000100:00100000:1.0:1789129351.945754:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626610688 00000100:00100000:1.0:1789129351.945788:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789129351.945795:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3309:x1876037626610688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789129351.945839:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789129351.945896:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3309:x1876037626610688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129351.945905:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789129351.945952:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bfcd6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626610688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129351.946587:0:15506:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789129351.946614:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789129351.946627:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626610048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129351.946684:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626610048:12345-0@lo:400:kworker.0 Request processed in 62us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129351.946691:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789129351.949698:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383caf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1876037626610176:12345-0@lo:400:kworker.0 Request processed in 4813us (6961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129351.949710:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789129351.949753:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626610560 00000100:00100000:2.0:1789129351.949761:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626610560 00000100:00100000:2.0:1789129351.949805:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626610432 00000100:00100000:2.0:1789129351.949809:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626610432 00000100:00100000:2.0:1789129351.949827:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789129351.949835:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626610560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129351.949869:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626610560:12345-0@lo:400:kworker.0 Request processed in 35us (5233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129351.949875:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789129351.949888:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789129351.949895:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626610432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129351.949923:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876037626610432:12345-0@lo:400:kworker.0 Request processed in 29us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129351.949929:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789129351.949952:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626609920 00000100:00100000:2.0:1789129351.949955:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626609920 00000100:00100000:2.0:1789129351.949980:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789129351.949986:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3307:x1876037626609920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129351.950017:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7759850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3307:x1876037626609920:12345-0@lo:400:kworker.0 Request processed in 32us (5319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129351.950032:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789129351.950063:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789129351.950069:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789129351.950071:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789129351.950107:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bfd76cf-bae1-432b-b8fe-46974cf010df:3307:1876037626609920:0@lo:400:kworker.0 00010000:00080000:2.0:1789129351.950125:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b383cacf00 x1876037626610432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129351.950138:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876037626610432:0@lo:400:kworker.0 00000100:00100000:2.0:1789129351.950153:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626610048:0@lo:400:kworker.0 00010000:00080000:2.0:1789129351.950163:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90b383cad2c0 x1876037626610560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789129367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789129351.950170:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626610560:0@lo:400:kworker.0 00000100:00100000:0.0:1789129351.972517:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626610176:0@lo:400:kworker.0 00000001:00080000:3.0:1789129352.084488:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1789129352.084552:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789129352.200874:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129352.802073:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129352.802252:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604586624 00000100:00100000:0.0:1789129352.802262:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604586624 00000100:00100000:0.0:1789129352.802313:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789129352.802322:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2366:x1876037604586624:12345-192.168.201.39@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789129352.802352:0:14810:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 0d10bd9f-8490-482b-9659-84991f17e225@192.168.201.39@tcp t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1789129352.802393:0:14810:0:(genops.c:1385:class_connect()) connect: client 0d10bd9f-8490-482b-9659-84991f17e225, cookie 0x5c74554e47ce5679 00000100:00080000:0.0:1789129352.802576:0:14810:0:(import.c:65:import_set_state_nolock()) ffff90b3828f2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789129352.802704:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+5:2366:x1876037604586624:12345-192.168.201.39@tcp:250:mount.lustre.0 Request processed in 381us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129352.802712:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 77 00000100:00100000:0.0:1789129352.819187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129352.819300:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604586752 00000100:00100000:2.0:1789129352.819312:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604586752 00000100:00100000:2.0:1789129352.819388:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:2.0:1789129352.819402:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+5:13973:x1876037604586752:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789129352.819425:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129352.819459:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b38285bc00/0x5c74554e47ce5680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aac5d expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129352.819504:0:14811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b38285bc00/0x5c74554e47ce5680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac5d expref: 6 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129352.819540:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b38285bc00/0x5c74554e47ce5680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac5d expref: 6 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129352.819551:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285bc00, rc 0) 00000100:00100000:2.0:1789129352.820028:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+6:13973:x1876037604586752:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 628us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129352.820037:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 78 00000100:00100000:1.0:1789129352.854334:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129352.857406:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604586880 00000100:00100000:3.0:1789129352.857428:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604586880 00000100:00100000:3.0:1789129352.857525:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1789129352.857536:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+6:13973:x1876037604586880:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789129352.858585:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+6:13973:x1876037604586880:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 1045us (4260us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789129352.858598:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 79 00000100:00100000:3.0:1789129352.881221:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129352.881411:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604587008 00000100:00100000:2.0:1789129352.881426:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604587008 00000100:00100000:2.0:1789129352.881512:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:2.0:1789129352.881523:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+6:13973:x1876037604587008:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789129352.881543:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129352.881565:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b38285be00/0x5c74554e47ce5687 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aac64 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129352.881599:0:14811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b38285be00/0x5c74554e47ce5687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac64 expref: 7 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129352.881658:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b38285be00/0x5c74554e47ce5687 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac64 expref: 7 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129352.881667:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285be00, rc 0) 00000100:00100000:2.0:1789129352.881731:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+7:13973:x1876037604587008:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 211us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129352.881740:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 80 00000100:00100000:0.0:1789129352.884291:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129352.884988:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604587136 00000100:00100000:3.0:1789129352.885002:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604587136 00000100:00100000:3.0:1789129352.885074:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:3.0:1789129352.885103:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b7758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+7:13973:x1876037604587136:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789129352.890713:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b7758050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+8:13973:x1876037604587136:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 5598us (6421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129352.890730:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 81 00000100:00100000:1.0:1789129352.902322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129352.902652:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604587264 00000100:00100000:0.0:1789129352.902667:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604587264 00000100:00100000:0.0:1789129352.902756:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:0.0:1789129352.902769:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+8:13973:x1876037604587264:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789129352.903144:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+8:13973:x1876037604587264:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 377us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129352.903161:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 82 00000100:00100000:2.0:1789129352.907850:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129352.908303:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604587392 00000100:00100000:3.0:1789129352.908313:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604587392 00000100:00100000:3.0:1789129352.908383:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1789129352.908396:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+8:13992:x1876037604587392:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789129352.908872:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+8:13992:x1876037604587392:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 477us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129352.908881:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 83 00000100:00100000:3.0:1789129352.929446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129352.929837:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604587520 00000100:00100000:2.0:1789129352.929860:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604587520 00000100:00100000:2.0:1789129352.929921:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1789129352.929932:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+8:13992:x1876037604587520:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789129352.930709:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+8:13992:x1876037604587520:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 772us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129352.930720:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 84 00000100:00100000:2.0:1789129352.953754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129352.953857:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604587648 00000100:00100000:0.0:1789129352.953868:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604587648 00000100:00100000:0.0:1789129352.953934:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:0.0:1789129352.953956:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+8:13973:x1876037604587648:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789129352.953975:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129352.953995:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b490363800/0x5c74554e47ce568e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aac8e expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129352.954025:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490363800/0x5c74554e47ce568e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac8e expref: 9 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129352.954037:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b490363800/0x5c74554e47ce568e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac8e expref: 9 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129352.954046:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363800, rc 0) 00000100:00100000:0.0:1789129352.954335:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+9:13973:x1876037604587648:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 382us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129352.954343:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 85 00000100:00100000:2.0:1789129352.971742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129352.972208:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604587776 00000100:00100000:3.0:1789129352.972221:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604587776 00000100:00100000:3.0:1789129352.972297:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:3.0:1789129352.972309:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+9:13973:x1876037604587776:12345-192.168.201.39@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789129352.972340:0:14811:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789129352.972379:0:14811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789129352.972384:0:14811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789129352.972387:0:14811:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789129352.972390:0:14811:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789129352.976347:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+9:13973:x1876037604587776:12345-192.168.201.39@tcp:256:mount.lustre.0 Request processed in 4025us (4605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129352.976375:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 86 00000100:00100000:2.0:1789129352.999898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129353.000050:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604587904 00000100:00100000:0.0:1789129353.000063:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604587904 00000100:00100000:0.0:1789129353.000146:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:0.0:1789129353.000161:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+9:13973:x1876037604587904:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789129353.000186:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129353.000212:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5695 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aac95 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129353.000263:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac95 expref: 10 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129353.000276:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac95 expref: 10 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129353.000287:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:0.0:1789129353.000380:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+10:13973:x1876037604587904:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 223us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129353.000388:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 87 00000100:00100000:2.0:1789129353.012336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129353.012597:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604588032 00000100:00100000:3.0:1789129353.013082:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604588032 00000100:00100000:2.0:1789129353.013217:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:2.0:1789129353.013228:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+10:13973:x1876037604588032:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789129353.013772:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+10:13973:x1876037604588032:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 544us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129353.013781:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 88 00000100:00100000:1.0:1789129353.020381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129353.020553:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604588160 00000100:00100000:3.0:1789129353.020567:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604588160 00000100:00100000:3.0:1789129353.020669:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:3.0:1789129353.020681:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+10:13973:x1876037604588160:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789129353.021301:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+10:13973:x1876037604588160:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 617us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129353.021312:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 89 00000100:00100000:1.0:1789129353.026132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129353.026340:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604588288 00000100:00100000:2.0:1789129353.026352:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604588288 00000100:00100000:2.0:1789129353.026403:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789129353.026413:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+10:13996:x1876037604588288:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789129353.026806:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+10:13996:x1876037604588288:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 392us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129353.026816:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 90 00000100:00100000:2.0:1789129353.031682:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129353.031766:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604588416 00000100:00100000:0.0:1789129353.031776:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604588416 00000100:00100000:0.0:1789129353.031849:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:0.0:1789129353.031861:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+10:13996:x1876037604588416:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789129353.032130:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+10:13996:x1876037604588416:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 271us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129353.032139:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 91 00000100:00100000:1.0:1789129353.046765:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129353.047592:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604588544 00000100:00100000:2.0:1789129353.047665:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604588544 00000100:00100000:2.0:1789129353.047711:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:2.0:1789129353.048094:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2366:x1876037604588544:12345-192.168.201.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789129353.048130:0:14816:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from d6caeeb8-7d2f-4bb2-acfe-09b088540ed0@192.168.201.39@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1789129353.048185:0:14816:0:(genops.c:1385:class_connect()) connect: client d6caeeb8-7d2f-4bb2-acfe-09b088540ed0, cookie 0x5c74554e47ce569c 00000004:00100000:2.0:1789129353.048219:0:14816:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000001:00000004:2.0:1789129353.048226:0:14816:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789129353.146699:0:14816:0:(import.c:65:import_set_state_nolock()) ffff90b3812fb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789129353.146793:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2366:x1876037604588544:12345-192.168.201.39@tcp:38:mount.lustre.0 Request processed in 99071us (100040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129353.146805:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:1.0:1789129353.160577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129353.165046:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604588800 00000100:00100000:2.0:1789129353.165070:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604588800 00000100:00100000:2.0:1789129353.165201:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1789129353.165214:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:13973:x1876037604588800:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789129353.165279:0:14817:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1789129353.165550:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789129353.165685:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:13973:x1876037604588800:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 472us (5115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129353.165695:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1789129353.169384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129353.169539:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604588672 00000100:00100000:2.0:1789129353.169551:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604588672 00000100:00100000:2.0:1789129353.169659:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:2.0:1789129353.169671:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:0:x1876037604588672:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789129353.169715:0:14816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789129353.169792:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b48a171e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:0:x1876037604588672:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 124us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129353.169818:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1789129353.173219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129353.173664:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604588928 00000100:00100000:2.0:1789129353.173676:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604588928 00000100:00100000:2.0:1789129353.173752:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789129353.173765:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:13973:x1876037604588928:12345-192.168.201.39@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789129353.173900:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:13973:x1876037604588928:12345-192.168.201.39@tcp:40:mount.lustre.0 Request processed in 137us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129353.173909:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:1.0:1789129353.187567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129353.187668:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129353.187715:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129353.187771:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604589056 00000100:00100000:0.0:1789129353.187785:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604589056 00000100:00100000:3.0:1789129353.187814:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604589184 00000100:00100000:3.0:1789129353.187820:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604589184 00000100:00100000:0.0:1789129353.187856:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789129353.187925:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1876037604589056:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789129353.187981:0:15504:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from d6caeeb8-7d2f-4bb2-acfe-09b088540ed0@192.168.201.39@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:0.0:1789129353.188032:0:15504:0:(genops.c:1385:class_connect()) connect: client d6caeeb8-7d2f-4bb2-acfe-09b088540ed0, cookie 0x5c74554e47ce56a3 00002000:00100000:0.0:1789129353.188048:0:15504:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d6caeeb8-7d2f-4bb2-acfe-09b088540ed0/ffff90b3828f6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789129353.188100:0:15504:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1789129353.188514:0:15504:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789129353.188547:0:15504:0:(import.c:65:import_set_state_nolock()) ffff90b3828f4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789129353.188657:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2366:x1876037604589056:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 734us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129353.188736:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604589312 00000100:00100000:2.0:1789129353.188742:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604589312 00000100:00100000:2.0:1789129353.188781:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789129353.188789:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:13973:x1876037604589312:12345-192.168.201.39@tcp:33:mount.lustre.0 00000100:00100000:3.0:1789129353.188878:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:3.0:1789129353.188886:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2366:x1876037604589184:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789129353.188911:0:15506:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from d6caeeb8-7d2f-4bb2-acfe-09b088540ed0@192.168.201.39@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:3.0:1789129353.188935:0:15506:0:(genops.c:1385:class_connect()) connect: client d6caeeb8-7d2f-4bb2-acfe-09b088540ed0, cookie 0x5c74554e47ce56aa 00002000:00100000:3.0:1789129353.188942:0:15506:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d6caeeb8-7d2f-4bb2-acfe-09b088540ed0/ffff90b485292000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789129353.188950:0:15506:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1789129353.189258:0:15506:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789129353.189279:0:15506:0:(import.c:65:import_set_state_nolock()) ffff90b485296000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789129353.189315:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2366:x1876037604589184:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 428us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129353.189323:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000004:00080000:3.0:1789129353.189544:0:14819:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 700us 00000100:00100000:0.0:1789129353.201277:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000004:00200000:2.0:1789129353.213723:0:14819:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1789129353.213925:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:13973:x1876037604589312:12345-192.168.201.39@tcp:33:mount.lustre.0 Request processed in 25130us (26250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129353.213938:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00010000:00010000:2.0:1789129353.223719:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129353.512133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129353.512247:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604589440 00000100:00100000:0.0:1789129353.512259:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604589440 00000100:00100000:0.0:1789129353.512339:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:0.0:1789129353.512361:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:14018:x1876037604589440:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:0.0:1789129353.512388:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129353.512418:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce56b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aacbf expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129353.512508:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce56b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129353.512522:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce56b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129353.512538:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce56b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129353.512970:0:14818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789129353.512975:0:14818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1789129353.513085:0:14818:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce56b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129353.513118:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce56b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aacbf expref: 8 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129353.513145:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce56b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aacbf expref: 7 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129353.513153:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:0.0:1789129353.513156:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789129353.513159:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363400, rc 0) 00000100:00100000:0.0:1789129353.513285:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:14018:x1876037604589440:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 937us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129353.513294:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00010000:00010000:2.0:1789129354.246032:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129355.014155:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626610816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789129355.014252:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129355.014788:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626610816 00000100:00100000:3.0:1789129355.014800:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626610816 00000100:00100000:3.0:1789129355.014883:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789129355.014895:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626610816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129355.014939:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129355.015023:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626610816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129355.015031:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789129355.015090:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b21a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626610816:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789129355.015178:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789129355.270069:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789129355.572303:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d6caeeb8-7d2f-4bb2-acfe-09b088540ed0 00000100:00100000:2.0:1789129355.889770:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129355.891746:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604589568 00000100:00100000:0.0:1789129355.891761:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604589568 00000100:00100000:0.0:1789129355.891869:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789129355.891882:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a7888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:14070:x1876037604589568:12345-192.168.201.39@tcp:41:lfs.0 00000004:00000024:0.0:1789129355.891939:0:14816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789129355.892045:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a7888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:14070:x1876037604589568:12345-192.168.201.39@tcp:41:lfs.0 Request processed in 166us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129355.892053:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00080000:1.0:1789129355.892389:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129355.902178:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129355.902297:0:15508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604589696 00000100:00100000:2.0:1789129355.902307:0:15508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604589696 00000100:00100000:2.0:1789129355.902394:0:15508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:2.0:1789129355.902406:0:15508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:14070:x1876037604589696:12345-192.168.201.39@tcp:13:lfs.0 00002000:00000024:2.0:1789129355.902460:0:15508:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129355.902560:0:15508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:14070:x1876037604589696:12345-192.168.201.39@tcp:13:lfs.0 Request processed in 156us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129355.902568:0:15508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00080000:1.0:1789129355.902802:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789129355.907800:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129355.908532:0:15508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604589824 00000100:00100000:2.0:1789129355.908550:0:15508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604589824 00000100:00100000:2.0:1789129355.908688:0:15508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:2.0:1789129355.908701:0:15508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:14070:x1876037604589824:12345-192.168.201.39@tcp:13:lfs.0 00002000:00000024:2.0:1789129355.908748:0:15508:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129355.908860:0:15508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:14070:x1876037604589824:12345-192.168.201.39@tcp:13:lfs.0 Request processed in 162us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129355.908868:0:15508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00080000:1.0:1789129355.909045:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129356.279282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129356.279576:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604589952 00000100:00100000:3.0:1789129356.279589:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604589952 00000100:00100000:3.0:1789129356.279711:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:3.0:1789129356.279723:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+10:14099:x1876037604589952:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789129356.279747:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129356.279782:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce56bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aacc6 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129356.279822:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce56bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aacc6 expref: 11 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129356.279834:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf2a00/0x5c74554e47ce56bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aacc6 expref: 11 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129356.279844:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2a00, rc 0) 00000100:00100000:3.0:1789129356.279931:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+11:14099:x1876037604589952:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 207us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129356.279939:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 92 00000100:00100000:0.0:1789129356.288756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129356.288939:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604590080 00000100:00100000:2.0:1789129356.288952:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604590080 00000100:00100000:2.0:1789129356.289016:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:2.0:1789129356.289026:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+11:14099:x1876037604590080:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789129356.289485:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+11:14099:x1876037604590080:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 457us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129356.289496:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 93 00000100:00100000:2.0:1789129356.294472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129356.295504:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604590208 00000100:00100000:0.0:1789129356.295522:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604590208 00000100:00100000:0.0:1789129356.295757:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 94 00010000:00010000:2.0:1789129356.296007:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129356.296216:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+11:14099:x1876037604590208:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789129356.296575:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+11:14099:x1876037604590208:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 366us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.296595:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 94 00000100:00100000:0.0:1789129356.315448:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129356.318860:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604590336 00000100:00100000:3.0:1789129356.318878:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604590336 00000100:00100000:3.0:1789129356.319024:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:3.0:1789129356.319036:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+11:14107:x1876037604590336:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789129356.320094:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+11:14107:x1876037604590336:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 1055us (4661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129356.320116:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 95 00000100:00100000:1.0:1789129356.362652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129356.363266:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604590464 00000100:00100000:0.0:1789129356.363280:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604590464 00000100:00100000:0.0:1789129356.363348:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:0.0:1789129356.363360:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+11:14107:x1876037604590464:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789129356.365264:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+11:14107:x1876037604590464:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 1893us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.365282:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 96 00000100:00100000:0.0:1789129356.386008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129356.386559:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604590592 00000100:00100000:2.0:1789129356.386570:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604590592 00000100:00100000:2.0:1789129356.386676:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:2.0:1789129356.386686:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b775d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+11:14099:x1876037604590592:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789129356.386721:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129356.386742:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b38285a400/0x5c74554e47ce56c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aacf0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129356.386955:0:14811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b38285a400/0x5c74554e47ce56c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf0 expref: 12 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129356.386968:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b38285a400/0x5c74554e47ce56c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf0 expref: 12 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129356.386978:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285a400, rc 0) 00000100:00100000:2.0:1789129356.387041:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b775d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+12:14099:x1876037604590592:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 357us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129356.387049:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 97 00000100:00100000:2.0:1789129356.401197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129356.401309:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604590720 00000100:00100000:0.0:1789129356.401324:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604590720 00000100:00100000:0.0:1789129356.401394:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:0.0:1789129356.401406:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+12:14099:x1876037604590720:12345-192.168.201.39@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789129356.401452:0:14810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789129356.401484:0:14810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789129356.401489:0:14810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789129356.401492:0:14810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789129356.401495:0:14810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789129356.414480:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+12:14099:x1876037604590720:12345-192.168.201.39@tcp:256:mount.lustre.0 Request processed in 13059us (13279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.414502:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 98 00000100:00100000:2.0:1789129356.445367:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129356.445512:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604590848 00000100:00100000:3.0:1789129356.445526:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604590848 00000100:00100000:3.0:1789129356.446060:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:3.0:1789129356.446073:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+12:14099:x1876037604590848:12345-192.168.201.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789129356.446093:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129356.446113:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce56cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aacf7 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129356.446151:0:14811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce56cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf7 expref: 13 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129356.446164:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce56cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf7 expref: 13 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129356.446173:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3400, rc 0) 00000100:00100000:3.0:1789129356.446247:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+13:14099:x1876037604590848:12345-192.168.201.39@tcp:101:mount.lustre.0 Request processed in 177us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129356.446254:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 99 00000100:00100000:1.0:1789129356.456702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129356.456805:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604590976 00000100:00100000:0.0:1789129356.456817:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604590976 00000100:00100000:0.0:1789129356.456885:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:0.0:1789129356.456896:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:14099:x1876037604590976:12345-192.168.201.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789129356.457394:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:14099:x1876037604590976:12345-192.168.201.39@tcp:501:mount.lustre.0 Request processed in 497us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.457403:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 100 00000100:00100000:1.0:1789129356.469663:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129356.469828:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604591104 00000100:00100000:3.0:1789129356.469842:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604591104 00000100:00100000:3.0:1789129356.470023:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:3.0:1789129356.470037:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+13:14099:x1876037604591104:12345-192.168.201.39@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789129356.470404:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+13:14099:x1876037604591104:12345-192.168.201.39@tcp:503:mount.lustre.0 Request processed in 369us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129356.470412:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 101 00000100:00100000:2.0:1789129356.479152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129356.479320:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604591232 00000100:00100000:0.0:1789129356.479332:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604591232 00000100:00100000:0.0:1789129356.479450:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:0.0:1789129356.479462:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:14113:x1876037604591232:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789129356.480033:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:14113:x1876037604591232:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 572us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.480042:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 102 00000100:00100000:1.0:1789129356.502406:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129356.502866:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604591360 00000100:00100000:3.0:1789129356.502888:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604591360 00000100:00100000:3.0:1789129356.502955:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:3.0:1789129356.502965:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+13:14113:x1876037604591360:12345-192.168.201.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789129356.503269:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+13:14113:x1876037604591360:12345-192.168.201.39@tcp:502:llog_process_th.0 Request processed in 304us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129356.503278:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 103 00000100:00100000:1.0:1789129356.554109:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129356.554226:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604591488 00000100:00100000:2.0:1789129356.554238:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604591488 00000100:00100000:2.0:1789129356.554289:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789129356.554305:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2366:x1876037604591488:12345-192.168.201.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789129356.554334:0:14817:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 95fac8e8-2023-47db-8e7f-1db7b77a81bc@192.168.201.39@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1789129356.554370:0:14817:0:(genops.c:1385:class_connect()) connect: client 95fac8e8-2023-47db-8e7f-1db7b77a81bc, cookie 0x5c74554e47ce56d4 00000004:00100000:2.0:1789129356.554406:0:14817:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1789129356.554524:0:14817:0:(import.c:65:import_set_state_nolock()) ffff90b4888e5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789129356.554591:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2366:x1876037604591488:12345-192.168.201.39@tcp:38:mount.lustre.0 Request processed in 285us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129356.554642:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789129356.562220:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129356.562310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129356.569632:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604591744 00000100:00100000:0.0:1789129356.569655:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604591744 00000100:00080000:1.0:1789129356.570115:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129356.570554:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604591616 00000100:00100000:0.0:1789129356.570562:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604591616 00000100:00100000:0.0:1789129356.570595:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1789129356.570630:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+7:14099:x1876037604591744:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789129356.570688:0:14818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789129356.570777:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+7:14099:x1876037604591744:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 173us (8567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.570785:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:0.0:1789129356.570917:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1789129356.570925:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a78883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:0:x1876037604591616:12345-192.168.201.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789129356.570937:0:14818:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789129356.570961:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a78883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:0:x1876037604591616:12345-192.168.201.39@tcp:41:mount.lustre.0 Request processed in 37us (8650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.570983:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789129356.592324:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129356.592513:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604591872 00000100:00100000:0.0:1789129356.592523:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604591872 00000100:00100000:0.0:1789129356.592592:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1789129356.592627:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:14099:x1876037604591872:12345-192.168.201.39@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789129356.592735:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:14099:x1876037604591872:12345-192.168.201.39@tcp:40:mount.lustre.0 Request processed in 134us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.592743:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:1.0:1789129356.612687:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129356.612735:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129356.612976:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604592000 00000100:00100000:3.0:1789129356.612989:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604592000 00000100:00100000:3.0:1789129356.613050:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1789129356.613062:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2366:x1876037604592000:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789129356.613104:0:15506:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 95fac8e8-2023-47db-8e7f-1db7b77a81bc@192.168.201.39@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:3.0:1789129356.613144:0:15506:0:(genops.c:1385:class_connect()) connect: client 95fac8e8-2023-47db-8e7f-1db7b77a81bc, cookie 0x5c74554e47ce56db 00002000:00100000:3.0:1789129356.613162:0:15506:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 95fac8e8-2023-47db-8e7f-1db7b77a81bc/ffff90b4bb011800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789129356.613176:0:15506:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1789129356.613749:0:15506:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1789129356.613922:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129356.613992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129356.614013:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129356.614031:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00080000:3.0:1789129356.614083:0:15506:0:(import.c:65:import_set_state_nolock()) ffff90b4bb011000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789129356.614163:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2366:x1876037604592000:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 1100us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129356.614174:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:0.0:1789129356.614250:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604592768 00000100:00100000:0.0:1789129356.614257:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604592768 00000100:00100000:0.0:1789129356.614309:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604592384 00000100:00100000:0.0:1789129356.614313:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604592384 00000100:00100000:0.0:1789129356.614330:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789129356.614338:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2370:x1876037604592768:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129356.614392:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2370:x1876037604592768:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 54us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.614399:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789129356.614412:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1789129356.614418:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:2370:x1876037604592384:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129356.614454:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:2370:x1876037604592384:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.614460:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:0.0:1789129356.614483:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604592256 00000100:00100000:0.0:1789129356.614487:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604592256 00000100:00100000:0.0:1789129356.614515:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:0.0:1789129356.614542:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:2370:x1876037604592256:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129356.614569:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:2370:x1876037604592256:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 31us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129356.614576:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 104 00000100:00100000:1.0:1789129356.617404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129356.617451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129356.618046:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604592512 00000100:00100000:3.0:1789129356.618071:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604592512 00000100:00100000:3.0:1789129356.618130:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604592640 00000100:00100000:3.0:1789129356.618134:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604592640 00000100:00100000:3.0:1789129356.618154:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789129356.618164:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2370:x1876037604592512:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129356.618266:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bfcd52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2370:x1876037604592512:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 103us (4343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129356.618274:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789129356.618938:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:3.0:1789129356.618950:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2370:x1876037604592640:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129356.618991:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2370:x1876037604592640:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 45us (4959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129356.618998:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789129356.620359:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604592896 00000100:00100000:2.0:1789129356.620371:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604592896 00000100:00100000:2.0:1789129356.620437:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:2.0:1789129356.620447:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:14099:x1876037604592896:12345-192.168.201.39@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789129356.620713:0:14820:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1789129356.621565:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:14099:x1876037604592896:12345-192.168.201.39@tcp:33:mount.lustre.0 Request processed in 1113us (4168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129356.621575:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1789129356.624006:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604592128 00000100:00100000:3.0:1789129356.624023:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604592128 00000100:00100000:3.0:1789129356.624244:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:3.0:1789129356.624254:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2366:x1876037604592128:12345-192.168.201.39@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789129356.624288:0:15506:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 95fac8e8-2023-47db-8e7f-1db7b77a81bc@192.168.201.39@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:3.0:1789129356.624464:0:15506:0:(genops.c:1385:class_connect()) connect: client 95fac8e8-2023-47db-8e7f-1db7b77a81bc, cookie 0x5c74554e47ce56e2 00002000:00100000:3.0:1789129356.624478:0:15506:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 95fac8e8-2023-47db-8e7f-1db7b77a81bc/ffff90b4bb012000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113985 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789129356.624490:0:15506:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1789129356.624643:0:15506:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789129356.624681:0:15506:0:(import.c:65:import_set_state_nolock()) ffff90b485290000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789129356.624751:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2366:x1876037604592128:12345-192.168.201.39@tcp:8:mount.lustre.0 Request processed in 496us (7298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129356.628536:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:0.0:1789129356.822021:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129356.822089:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604593024 00000100:00100000:1.0:1789129356.822099:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604593024 00000100:00100000:1.0:1789129356.822159:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789129356.822169:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:14135:x1876037604593024:12345-192.168.201.39@tcp:101:mkdir.0 00010000:00010000:1.0:1789129356.822190:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129356.822216:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ce56e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad21 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129356.822285:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129356.822306:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129356.822317:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129356.824361:0:14818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789129356.824372:0:14818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129356.824660:0:14818:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129356.824708:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ce56e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad21 expref: 8 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129356.824731:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad21 expref: 7 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129356.824740:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:2.0:1789129356.824743:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789129356.824747:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030c00, rc 0) 00000100:00100000:2.0:1789129356.824873:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+7:14135:x1876037604593024:12345-192.168.201.39@tcp:101:mkdir.0 Request processed in 2703us (2859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129356.824893:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000040:00080000:1.0:1789129357.000090:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789129357.061840:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626610944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129357.061930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129357.062491:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626611456:0@lo:400:kworker.0 00000100:00100000:1.0:1789129357.062538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129357.062564:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789129357.062570:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bfd76cf-bae1-432b-b8fe-46974cf010df:3306:1876037626611072:0@lo:400:kworker.0 00000100:00100000:1.0:1789129357.062595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129357.062636:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626611584:0@lo:400:kworker.0 00000100:00100000:1.0:1789129357.062658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129357.062683:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626611456 00000100:00100000:1.0:1789129357.062689:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626611456 00000100:00100000:1.0:1789129357.062734:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626611584 00000100:00100000:1.0:1789129357.062736:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626611584 00000100:00100000:1.0:1789129357.062752:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789129357.062761:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626611456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129357.062810:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876037626611456:12345-0@lo:400:kworker.0 Request processed in 50us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129357.062818:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789129357.062835:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789129357.062841:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626611584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129357.062868:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626611584:12345-0@lo:400:kworker.0 Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129357.062874:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789129357.062890:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789129357.062921:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626611584:0@lo:400:kworker.0 00000100:00100000:1.0:1789129357.062932:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876037626611456:0@lo:400:kworker.0 00000100:00100000:1.0:1789129357.062972:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626611072 00000100:00100000:1.0:1789129357.062975:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626611072 00000100:00100000:1.0:1789129357.063000:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789129357.063016:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3306:x1876037626611072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129357.063052:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3306:x1876037626611072:12345-0@lo:400:kworker.0 Request processed in 40us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129357.063060:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789129357.063098:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bfd76cf-bae1-432b-b8fe-46974cf010df:3306:1876037626611072:0@lo:400:kworker.0 00000100:00100000:2.0:1789129357.064269:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626611200:0@lo:400:kworker.0 00000100:00100000:2.0:1789129357.064327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129357.064374:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789129357.064381:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626611328:0@lo:400:kworker.0 00000100:00100000:2.0:1789129357.064409:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129357.064465:0:15508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626610944 00000100:00100000:2.0:1789129357.064471:0:15508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626610944 00000100:00100000:2.0:1789129357.064522:0:15508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789129357.064530:0:15508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626610944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789129357.064551:0:15508:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129357.064593:0:15508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626610944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129357.064622:0:15508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789129357.064641:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789129357.064651:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626611328 00000100:00100000:2.0:1789129357.064654:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626611328 00000100:00100000:2.0:1789129357.064674:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789129357.064680:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626611328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789129357.064717:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626611328:12345-0@lo:400:kworker.0 Request processed in 36us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129357.064724:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789129357.064758:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626611328:0@lo:400:kworker.0 00000100:00100000:1.0:1789129357.065576:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789129357.065598:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626610944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129357.065669:0:16662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626611200 00000100:00100000:1.0:1789129357.065674:0:16662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626611200 00000100:00100000:1.0:1789129357.065718:0:16662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789129357.065725:0:16662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626611200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129357.065781:0:16662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626611200:12345-0@lo:400:kworker.0 Request processed in 56us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129357.065787:0:16662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789129357.066160:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129357.066191:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626611200:0@lo:400:kworker.0 00000001:00100000:2.0:1789129357.151026:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95fac8e8-2023-47db-8e7f-1db7b77a81bc 00000001:00100000:2.0:1789129357.151055:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d6caeeb8-7d2f-4bb2-acfe-09b088540ed0 00010000:00010000:2.0:1789129357.318305:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789129358.150202:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95fac8e8-2023-47db-8e7f-1db7b77a81bc 00000001:00100000:0.0:1789129358.150228:0:5862:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d6caeeb8-7d2f-4bb2-acfe-09b088540ed0 00010000:00010000:0.0:1789129358.345334:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129359.365973:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789129360.144093:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789129360.144126:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626611712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789129360.144209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129360.147033:0:15508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626611712 00000100:00100000:0.0:1789129360.147047:0:15508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626611712 00000100:00100000:0.0:1789129360.147123:0:15508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789129360.147143:0:15508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626611712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789129360.147185:0:15508:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129360.147269:0:15508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626611712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (3059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129360.147277:0:15508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789129360.147744:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626611712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789129360.147917:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789129360.391194:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789129360.640178:0:16791:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1789129360.727809:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95fac8e8-2023-47db-8e7f-1db7b77a81bc 00010000:00010000:2.0:1789129361.414234:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129361.952902:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129361.952956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129361.952971:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604593152 00000100:00100000:0.0:1789129361.952982:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604593152 00000100:00100000:1.0:1789129361.952992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129361.953018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129361.953037:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:1.0:1789129361.953038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129361.953049:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+13:2369:x1876037604593152:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129361.953053:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604593408 00000100:00100000:2.0:1789129361.953059:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604593408 00000100:00100000:1.0:1789129361.953061:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129361.953087:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129361.953113:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604593920 00000100:00100000:2.0:1789129361.953117:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604593920 00000100:00100000:2.0:1789129361.953134:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604593536 00000100:00100000:2.0:1789129361.953136:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604593536 00000100:00100000:3.0:1789129361.953147:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604593664 00000100:00100000:2.0:1789129361.953151:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604593792 00000100:00100000:3.0:1789129361.953154:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604593664 00000100:00100000:2.0:1789129361.953156:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604593792 00000100:00100000:2.0:1789129361.953178:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:2.0:1789129361.953188:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2369:x1876037604593408:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:3.0:1789129361.953199:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604593280 00000100:00100000:3.0:1789129361.953204:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604593280 00000100:00100000:3.0:1789129361.953232:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:3.0:1789129361.953240:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2369:x1876037604593664:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129361.953294:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+13:2369:x1876037604593152:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 248us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129361.953302:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 106 00000100:00100000:0.0:1789129361.953371:0:16662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789129361.953393:0:16662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2369:x1876037604593920:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129361.955328:0:15505:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789129361.955354:0:15505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:1.0:1789129361.955412:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789129361.955418:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789129361.955420:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129361.955444:0:14818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789129361.955450:0:14818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789129361.955466:0:14816:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789129361.955480:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1789129361.955493:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2369:x1876037604593280:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129361.955562:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2369:x1876037604593280:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 73us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129361.955570:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1789129361.955596:0:15506:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789129361.955685:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:1.0:1789129361.955692:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2369:x1876037604593536:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129361.955717:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2369:x1876037604593536:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (2657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129361.955722:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:1.0:1789129361.955737:0:15506:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789129361.955742:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:1.0:1789129361.955747:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2369:x1876037604593792:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129361.955766:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2369:x1876037604593792:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 19us (2678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129361.955772:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1789129361.960003:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2369:x1876037604593664:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 6748us (6993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129361.960003:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2369:x1876037604593408:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 6802us (7030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129361.960029:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:3.0:1789129361.960030:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:0.0:1789129361.966624:0:16662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2369:x1876037604593920:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 13206us (13578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129361.966641:0:16662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:0.0:1789129362.186239:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626611840:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.186345:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129362.186399:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626612352:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.186430:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129362.186458:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789129362.186464:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626612224:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.186486:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129362.186516:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626611968:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.186546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129362.186566:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626612480:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.186589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129362.186632:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129362.186638:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b383cad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626612096:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.186660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129362.186693:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626611840 00000100:00100000:0.0:1789129362.186700:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626611840 00000100:00100000:0.0:1789129362.186746:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789129362.186755:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3309:x1876037626611840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.186807:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3309:x1876037626611840:12345-0@lo:400:kworker.0 Request processed in 53us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129362.186814:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789129362.186862:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626612352 00000100:00100000:0.0:1789129362.186866:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626612352 00000100:00100000:0.0:1789129362.186898:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626612224 00000100:00100000:0.0:1789129362.186901:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626612224 00000100:00100000:0.0:1789129362.187347:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626612480 00000100:00100000:0.0:1789129362.187352:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626612480 00000100:00100000:0.0:1789129362.187376:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789129362.187384:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626612352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.187429:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626612352:12345-0@lo:400:kworker.0 Request processed in 46us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129362.187436:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789129362.187448:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789129362.187453:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626612224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.187479:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876037626612224:12345-0@lo:400:kworker.0 Request processed in 26us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129362.187485:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789129362.187494:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789129362.187500:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382821a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626612480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.187533:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382821a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876037626612480:12345-0@lo:400:kworker.0 Request processed in 34us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129362.187539:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789129362.187567:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626611968 00000100:00100000:0.0:1789129362.187571:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626611968 00000100:00100000:0.0:1789129362.187639:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626612096 00000100:00100000:0.0:1789129362.187643:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626612096 00000100:00100000:0.0:1789129362.187667:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789129362.187674:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382822d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626611968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.187708:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382822d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626611968:12345-0@lo:400:kworker.0 Request processed in 35us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129362.187722:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789129362.187734:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789129362.187740:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626612096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.187770:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626612096:12345-0@lo:400:kworker.0 Request processed in 31us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129362.187776:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789129362.187808:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789129362.187812:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789129362.187815:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129362.187845:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626612096:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.187857:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626611968:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.187866:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876037626612480:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.189854:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876037626612224:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.189908:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626611840:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.190126:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b383cacf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626612352:0@lo:400:kworker.0 00000100:00100000:0.0:1789129362.196209:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626612608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129362.196308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129362.196425:0:15508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626612608 00000100:00100000:3.0:1789129362.196435:0:15508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626612608 00000100:00100000:3.0:1789129362.196498:0:15508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789129362.196509:0:15508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626612608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789129362.196553:0:15508:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129362.214085:0:15508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626612608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17563us (17761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129362.214104:0:15508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789129362.214323:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626612608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789129362.439697:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129363.465126:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789129364.485887:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789129364.686580:0:16942:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca182ca00 20000000:00000080:0.0:1789129364.686825:0:16942:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90b4927fc800 uarg=0000000000000000 20000000:01000000:0.0:1789129364.686890:0:16942:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789129364.686910:0:16942:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789129364.686916:0:16942:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789129364.688178:0:16943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789129364.691354:0:16942:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789129364.704231:0:16942:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789129364.704399:0:16942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704421:0:16942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b488bf3200/0x5c74554e47ce53ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce53e7 expref: 18 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704455:0:16942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b4926ebe00/0x5c74554e47ce543b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce5434 expref: 18 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704463:0:16942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b490363600/0x5c74554e47ce5576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce556f expref: 18 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704473:0:16942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5695 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aac95 expref: 12 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704481:0:16942:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce56cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf7 expref: 12 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704488:0:16942:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704536:0:16942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce56cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf7 expref: 12 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704568:0:16942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce56cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf7 expref: 12 pid: 14811 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.704585:0:16942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16942:1876037626612736:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129364.704777:0:16942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5695 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac95 expref: 12 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704786:0:16942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5695 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac95 expref: 12 pid: 14810 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.704795:0:16942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16942:1876037626612864:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129364.704836:0:16942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b490363600/0x5c74554e47ce5576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce556f expref: 18 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704845:0:16942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b490363600/0x5c74554e47ce5576 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce556f expref: 18 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.704854:0:16942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16942:1876037626612992:0@lo:104: 00000100:00100000:1.0:1789129364.704897:0:16942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789129364.704937:0:16942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b4926ebe00/0x5c74554e47ce543b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce5434 expref: 18 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.704945:0:16942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b4926ebe00/0x5c74554e47ce543b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce5434 expref: 18 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.704952:0:16942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4a788a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16942:1876037626613120:0@lo:104: 00000100:00100000:1.0:1789129364.704972:0:16942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789129364.704994:0:16942:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90b488bf3200/0x5c74554e47ce53ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5c74554e47ce53e7 expref: 18 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.705001:0:16942:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90b488bf3200/0x5c74554e47ce53ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5c74554e47ce53e7 expref: 18 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.705008:0:16942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16942:1876037626613248:0@lo:104: 00000100:00100000:1.0:1789129364.705035:0:16942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129364.705045:0:16942:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab000 going to sleep for 11 seconds 00000100:00100000:0.0:1789129364.705138:0:14799:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789129364.705151:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626612992 00000100:00100000:0.0:1789129364.705159:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626612992 00000100:00100000:0.0:1789129364.705215:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626613120 00000100:00100000:0.0:1789129364.705218:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626613120 00000100:00100000:0.0:1789129364.705229:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626613248 00000100:00100000:0.0:1789129364.705232:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626613248 00000100:00100000:0.0:1789129364.705245:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789129364.705255:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+5:16942:x1876037626612992:12345-0@lo:104: 00010000:00010000:0.0:1789129364.705268:0:14799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129364.705350:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789129364.705356:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+5:16942:x1876037626612992:12345-0@lo:104: Request processed in 104us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129364.705364:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789129364.705382:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789129364.705391:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+4:16942:x1876037626613120:12345-0@lo:104: 00010000:00010000:0.0:1789129364.705398:0:14799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129364.705431:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789129364.705436:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+4:16942:x1876037626613120:12345-0@lo:104: Request processed in 49us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129364.705442:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789129364.705462:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789129364.705470:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4baf1a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+3:16942:x1876037626613248:12345-0@lo:104: 00010000:00010000:0.0:1789129364.705477:0:14799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129364.705504:0:14799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789129364.705509:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4baf1a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bfd76cf-bae1-432b-b8fe-46974cf010df+3:16942:x1876037626613248:12345-0@lo:104: Request processed in 42us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129364.705515:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789129364.705557:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789129364.705562:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129364.705570:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4926eaa00 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:0.0:1789129364.705574:0:14805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.706211:0:16942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16942:1876037626612992:0@lo:104: 00000100:00100000:1.0:1789129364.706222:0:16942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4a788a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16942:1876037626613120:0@lo:104: 00000100:00100000:1.0:1789129364.706228:0:16942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16942:1876037626613248:0@lo:104: 00010000:00010000:2.0:1789129364.709725:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789129364.709956:0:14805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789129364.709972:0:14805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129364.709980:0:14805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789129364.710152:0:14805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.710166:0:14805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789129364.710191:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.710199:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4926eaa00/0x5c74554e47ce556f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce5576 expref: -99 pid: 16223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.710228:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626613376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129364.710318:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129364.710428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129364.711046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129364.711618:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626613376 00000100:00100000:1.0:1789129364.711630:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626613376 00010000:00010000:1.0:1789129364.711673:0:14802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b490363600/0x5c74554e47ce5576 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce556f expref: 19 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.711698:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604594048 00000100:00100000:1.0:1789129364.711702:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604594048 00010000:00010000:1.0:1789129364.711718:0:14802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce56cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf7 expref: 13 pid: 14811 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.711727:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604594176 00000100:00100000:1.0:1789129364.711729:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604594176 00010000:00010000:1.0:1789129364.711737:0:14802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5695 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac95 expref: 14 pid: 14810 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.711749:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789129364.711757:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3308:x1876037626613376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789129364.711773:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129364.711779:0:14802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b490363600/0x5c74554e47ce5576 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce556f expref: 19 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.711816:0:14802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b490363600/0x5c74554e47ce5576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce556f expref: 19 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.711836:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b490363600/0x5c74554e47ce5576 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce556f expref: 19 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.711853:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129364.711924:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:3308:x1876037626613376:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129364.711932:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789129364.711954:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1789129364.711961:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d10bd9f-8490-482b-9659-84991f17e225+14:2370:x1876037604594048:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129364.711969:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129364.711976:0:14802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce56cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf7 expref: 14 pid: 14811 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.711996:0:14802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce56cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf7 expref: 14 pid: 14811 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.712006:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129364.712052:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d10bd9f-8490-482b-9659-84991f17e225+14:2370:x1876037604594048:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 92us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129364.712059:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:1.0:1789129364.712073:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1789129364.712079:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d10bd9f-8490-482b-9659-84991f17e225+13:2370:x1876037604594176:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129364.712086:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129364.712096:0:14802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5695 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac95 expref: 13 pid: 14810 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.712105:0:14802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5695 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac95 expref: 13 pid: 14810 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.712115:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129364.712132:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d10bd9f-8490-482b-9659-84991f17e225+13:2370:x1876037604594176:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 53us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129364.712138:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00010000:00010000:1.0:1789129364.712320:0:14805:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789129364.712327:0:14805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.712335:0:14805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363200 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:1.0:1789129364.712339:0:14805:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.712348:0:14805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789129364.712356:0:14805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789129364.712362:0:14805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789129364.712409:0:14805:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.712417:0:14805:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789129364.712436:0:14805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.712453:0:14805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b490363200/0x5c74554e47ce53e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce53ee expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.712477:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626613504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129364.712514:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129364.712547:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626613504 00000100:00100000:1.0:1789129364.712552:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626613504 00010000:00010000:1.0:1789129364.712568:0:14802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b488bf3200/0x5c74554e47ce53ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce53e7 expref: 18 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.712588:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789129364.712594:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:3309:x1876037626613504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789129364.712624:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129364.712629:0:14802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b488bf3200/0x5c74554e47ce53ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce53e7 expref: 18 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.712637:0:14802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b488bf3200/0x5c74554e47ce53ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce53e7 expref: 18 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.712648:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b488bf3200/0x5c74554e47ce53ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce53e7 expref: 18 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129364.712657:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129364.712684:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:3309:x1876037626613504:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129364.712690:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789129364.712724:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626613504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789129364.712749:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129364.712751:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129364.712752:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129364.712777:0:16942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b488bf3400/0x5c74554e47ce56cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aacf7 expref: 12 pid: 14811 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.712786:0:16942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16942:1876037626612736:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129364.712813:0:16942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b490362c00/0x5c74554e47ce5695 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aac95 expref: 11 pid: 14810 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129364.712821:0:16942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ae4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16942:1876037626612864:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129364.712850:0:16942:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129364.714539:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626613376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129364.719070:0:16944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129364.719087:0:16944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789129364.719089:0:16944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129364.719201:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129364.719214:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b4b58da800 already unused, calling callback (ffffffffc1c28c20) 10000000:00010000:2.0:1789129364.719219:0:14804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129364.719231:0:14804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789129364.719250:0:14804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129364.719255:0:14804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789129364.719319:0:14804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129364.719326:0:14804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789129364.719362:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129364.719369:0:14804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.139@tcp lock: ffff90b4b58da800/0x5c74554e47ce5434 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5c74554e47ce543b expref: -99 pid: 15502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129364.719389:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129364.719391:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129364.719392:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129364.719495:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789129364.719517:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bfd76cf-bae1-432b-b8fe-46974cf010df:3307:1876037626613632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789129364.719598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129364.719756:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626613632 00000100:00100000:2.0:1789129364.719764:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626613632 00010000:00010000:3.0:1789129364.720018:0:14803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90b4926ebe00/0x5c74554e47ce543b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce5434 expref: 17 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129364.720056:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789129364.720068:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:3307:x1876037626613632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789129364.720081:0:14803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129364.720086:0:14803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90b4926ebe00/0x5c74554e47ce543b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5c74554e47ce5434 expref: 17 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720108:0:14803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90b4926ebe00/0x5c74554e47ce543b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5c74554e47ce5434 expref: 17 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720124:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b4926ebe00/0x5c74554e47ce543b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5c74554e47ce5434 expref: 17 pid: 14809 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720138:0:14803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720147:0:14803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720164:0:14803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720170:0:14803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720176:0:14803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720196:0:14803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720202:0:14803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031800 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129364.720205:0:14803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720213:0:14803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720356:0:14803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129364.720368:0:14803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789129364.720417:0:16942:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129364.720426:0:16942:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129364.720442:0:16942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90b480031800/0x5c74554e47ce56f7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129364.720448:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:3307:x1876037626613632:12345-0@lo:103:ldlm_bl.0 Request processed in 383us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129364.720456:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789129364.731084:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bfd76cf-bae1-432b-b8fe-46974cf010df:3307:1876037626613632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789129365.254829:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789129365.254860:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626613760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129365.254968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129365.255141:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626613760 00000100:00100000:3.0:1789129365.255148:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626613760 00000100:00100000:3.0:1789129365.255227:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789129365.255240:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626613760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129365.255289:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129365.255342:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626613760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129365.255350:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789129365.255399:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626613760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789129365.255533:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789129365.513967:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129365.859840:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129365.860856:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604594304 00000100:00100000:0.0:1789129365.860869:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604594304 00000100:00100000:0.0:1789129365.860930:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:0.0:1789129365.860941:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+11:13988:x1876037604594304:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789129365.860959:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129365.860989:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b490363e00/0x5c74554e47ce56fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aad28 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129365.861017:0:14811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490363e00/0x5c74554e47ce56fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad28 expref: 12 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129365.861029:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b490363e00/0x5c74554e47ce56fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad28 expref: 12 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129365.861039:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363e00, rc 0) 00000100:00100000:0.0:1789129365.861112:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+12:13988:x1876037604594304:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 173us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129365.861120:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 108 00000100:00100000:2.0:1789129365.877047:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129365.877096:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604594432 00000100:00100000:2.0:1789129365.877106:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604594432 00000100:00100000:2.0:1789129365.877162:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:2.0:1789129365.877173:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+12:13988:x1876037604594432:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129365.877502:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+12:13988:x1876037604594432:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 330us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129365.877510:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 109 00000100:00100000:1.0:1789129365.888886:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129365.888956:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604594560 00000100:00100000:0.0:1789129365.888968:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604594560 00000100:00100000:0.0:1789129365.889035:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:0.0:1789129365.889046:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+12:13988:x1876037604594560:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129365.889310:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+12:13988:x1876037604594560:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 265us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129365.889318:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 110 00000100:00100000:1.0:1789129365.903109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129365.904802:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604594688 00000100:00100000:0.0:1789129365.904821:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604594688 00000100:00100000:0.0:1789129365.904890:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:0.0:1789129365.904902:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bad10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+12:13988:x1876037604594688:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789129365.904922:0:14810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129365.904944:0:14810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b490362a00/0x5c74554e47ce5705 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd519138c592aad2f expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129365.904988:0:14810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b490362a00/0x5c74554e47ce5705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad2f expref: 13 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129365.905000:0:14810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b490362a00/0x5c74554e47ce5705 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad2f expref: 13 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129365.905010:0:14810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362a00, rc 0) 00000100:00100000:0.0:1789129365.905080:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bad10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:13988:x1876037604594688:12345-192.168.201.39@tcp:101:ll_cfg_requeue.0 Request processed in 180us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129365.905088:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 111 00000100:00100000:1.0:1789129365.908066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129365.908204:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604594816 00000100:00100000:3.0:1789129365.908233:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604594816 00000100:00100000:3.0:1789129365.908312:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:3.0:1789129365.908324:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+13:13988:x1876037604594816:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129365.909033:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b04850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d10bd9f-8490-482b-9659-84991f17e225+13:13988:x1876037604594816:12345-192.168.201.39@tcp:501:ll_cfg_requeue.0 Request processed in 706us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129365.909043:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 112 00000100:00100000:1.0:1789129365.918186:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129365.919573:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604594944 00000100:00100000:3.0:1789129365.919787:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604594944 00000100:00100000:3.0:1789129365.919853:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 113 00000100:00100000:3.0:1789129365.919864:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+13:13988:x1876037604594944:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129365.920123:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d10bd9f-8490-482b-9659-84991f17e225+13:13988:x1876037604594944:12345-192.168.201.39@tcp:503:ll_cfg_requeue.0 Request processed in 260us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129365.920134:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 113 00000040:00080000:0.0:1789129366.214394:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789129366.535261:0:16944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789129366.726391:0:14813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789129366.726402:0:14813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b4bb015000 from 13 10000000:01000000:1.0:1789129366.726407:0:14813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789129366.726457:0:14813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce570c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129366.726478:0:14813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce570c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129366.726490:0:14813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce570c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129366.726516:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626613888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789129366.726592:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129366.726666:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab540 going to sleep for 11 seconds 00000100:00100000:2.0:1789129366.726823:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626613888 00000100:00100000:2.0:1789129366.726832:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626613888 00000100:00100000:2.0:1789129366.726894:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789129366.726905:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+16:14813:x1876037626613888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129366.726918:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129366.726933:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b38285a000/0x5c74554e47ce5713 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce570c expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129366.726959:0:14811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b38285a000/0x5c74554e47ce5713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce570c expref: 17 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129366.726971:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b38285a000/0x5c74554e47ce5713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce570c expref: 17 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129366.726983:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285a000, rc 0) 00000100:00100000:2.0:1789129366.727036:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b05c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:14813:x1876037626613888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129366.727043:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789129366.728430:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626613888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789129366.728458:0:14813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce570c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5713 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129366.728468:0:14813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce570c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce5713 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129366.728544:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129366.728593:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129366.728754:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab540 going to sleep for 11 seconds 00000100:00100000:3.0:1789129366.731492:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626614016 00000100:00100000:3.0:1789129366.731506:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626614016 00000100:00100000:3.0:1789129366.731573:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789129366.731585:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:14813:x1876037626614016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129366.732120:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b06450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:14813:x1876037626614016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 536us (3524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129366.732131:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789129366.732146:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789129366.732213:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789129366.732279:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129366.732362:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860ab540 going to sleep for 11 seconds 00000100:00100000:2.0:1789129366.732460:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626614144 00000100:00100000:2.0:1789129366.732466:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626614144 00000100:00100000:2.0:1789129366.732541:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789129366.732550:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:14813:x1876037626614144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129366.732870:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:14813:x1876037626614144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 320us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129366.732877:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789129366.733055:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4bae79a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789129366.734898:0:17043:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789129366.735295:0:14813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789129366.735325:0:14813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789129366.735338:0:14813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce570c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5713 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129366.735350:0:14813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b480030000/0x5c74554e47ce570c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5713 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789129366.735361:0:14813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789129366.735364:0:14813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b489cb4000 from 13 10000000:01000000:2.0:1789129366.735366:0:14813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789129366.735409:0:14813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b38285a800/0x5c74554e47ce571a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129366.735416:0:14813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b38285a800/0x5c74554e47ce571a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129366.735426:0:14813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b38285a800/0x5c74554e47ce571a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129366.735456:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789129366.735530:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129366.735583:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626614272 00000100:00100000:2.0:1789129366.735585:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129366.735592:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626614272 00000100:00100000:3.0:1789129366.735671:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789129366.735691:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+17:14813:x1876037626614272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789129366.735708:0:14809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129366.735721:0:14809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce5721 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce571a expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129366.735747:0:14809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce5721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce571a expref: 18 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129366.735759:0:14809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b488bf2e00/0x5c74554e47ce5721 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce571a expref: 18 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129366.735768:0:14809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2e00, rc 0) 00000100:00100000:3.0:1789129366.735823:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:14813:x1876037626614272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129366.735831:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789129366.736098:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129366.736114:0:14813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b38285a800/0x5c74554e47ce571a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5721 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129366.736122:0:14813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b38285a800/0x5c74554e47ce571a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce5721 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129366.736175:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129366.740132:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129366.740189:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626614400 00000100:00100000:3.0:1789129366.740199:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626614400 00000100:00100000:3.0:1789129366.740858:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789129366.740873:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:14813:x1876037626614400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129366.741432:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b07850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:14813:x1876037626614400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 560us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129366.741444:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789129366.741506:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789129366.741541:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789129366.741623:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789129366.741673:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129366.741698:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789129366.742335:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626614528 00000100:00100000:0.0:1789129366.742344:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626614528 00000100:00100000:0.0:1789129366.742410:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789129366.742421:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:14813:x1876037626614528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129366.742670:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:14813:x1876037626614528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129366.742677:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789129366.742820:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b22940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789129366.744584:0:17044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789129366.744785:0:14813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789129366.744810:0:14813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789129366.744835:0:14813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b38285a800/0x5c74554e47ce571a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5721 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129366.744849:0:14813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b38285a800/0x5c74554e47ce571a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce5721 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789129366.744861:0:14813:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789129366.744878:0:14813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90b49bdce800 from 13 10000000:01000000:0.0:1789129366.744882:0:14813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789129366.744919:0:14813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce5728 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129366.744928:0:14813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce5728 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129366.744938:0:14813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce5728 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129366.744962:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382820f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789129366.745048:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129366.745107:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c202600 going to sleep for 11 seconds 00000100:00100000:2.0:1789129366.745979:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626614656 00000100:00100000:2.0:1789129366.745989:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626614656 00000100:00100000:2.0:1789129366.746043:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789129366.746053:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+18:14813:x1876037626614656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789129366.746069:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129366.746087:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90b38285b600/0x5c74554e47ce572f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c74554e47ce5728 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129366.746114:0:14811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90b38285b600/0x5c74554e47ce572f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5c74554e47ce5728 expref: 19 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129366.746292:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90b38285b600/0x5c74554e47ce572f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5c74554e47ce5728 expref: 19 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129366.746303:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285b600, rc 0) 00000100:00100000:2.0:1789129366.746372:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b07050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:14813:x1876037626614656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 321us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129366.746388:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789129366.746408:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382820f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789129366.746428:0:14813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce5728 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce572f expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129366.746438:0:14813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce5728 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5c74554e47ce572f expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129366.746557:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382820f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789129366.752018:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129366.752082:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c202600 going to sleep for 11 seconds 00000100:00100000:2.0:1789129366.753597:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626614784 00000100:00100000:2.0:1789129366.753639:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626614784 00000100:00100000:2.0:1789129366.753703:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789129366.753714:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b381b04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:14813:x1876037626614784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789129366.754109:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b381b04050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:14813:x1876037626614784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129366.754118:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789129366.754643:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382820f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789129366.754703:0:14813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382820f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789129366.754759:0:14813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129366.754790:0:14813:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49c202600 going to sleep for 11 seconds 00000100:00100000:2.0:1789129366.755205:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626614912 00000100:00100000:2.0:1789129366.755213:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626614912 00000100:00100000:2.0:1789129366.755267:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789129366.755277:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:14813:x1876037626614912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789129366.755462:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5722050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:14813:x1876037626614912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129366.755469:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789129366.757314:0:14813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382820f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bfd76cf-bae1-432b-b8fe-46974cf010df:14813:1876037626614912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789129366.758472:0:17045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789129366.758879:0:14813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789129366.758902:0:14813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789129366.758927:0:14813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce5728 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce572f expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129366.758939:0:14813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.139@tcp lock: ffff90b490362200/0x5c74554e47ce5728 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5c74554e47ce572f expref: -99 pid: 14813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129367.068355:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129367.068442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129367.068477:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129367.068511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129367.068535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129367.068556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129367.068581:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129367.068646:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604595584 00000100:00100000:2.0:1789129367.068656:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604595584 00000100:00100000:2.0:1789129367.068712:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604595200 00000100:00100000:2.0:1789129367.068716:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604595200 00000100:00100000:2.0:1789129367.068741:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1789129367.068766:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2370:x1876037604595584:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129367.068845:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2370:x1876037604595584:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 81us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129367.068853:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1789129367.068873:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789129367.068880:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2370:x1876037604595200:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129367.068906:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2370:x1876037604595200:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129367.068912:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789129367.068932:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604595328 00000100:00100000:2.0:1789129367.068936:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604595328 00000100:00100000:2.0:1789129367.068959:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604595840 00000100:00100000:2.0:1789129367.068962:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604595840 00000100:00100000:2.0:1789129367.068973:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604595456 00000100:00100000:2.0:1789129367.068976:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604595456 00000100:00100000:2.0:1789129367.068988:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604595712 00000100:00100000:2.0:1789129367.068991:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604595712 00000100:00100000:2.0:1789129367.069005:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789129367.069012:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2370:x1876037604595328:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129367.069039:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2370:x1876037604595328:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129367.069045:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789129367.069058:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789129367.069064:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2370:x1876037604595840:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129367.069088:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2370:x1876037604595840:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 24us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129367.069101:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:2.0:1789129367.069114:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1789129367.069120:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2370:x1876037604595456:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129367.069144:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2370:x1876037604595456:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129367.069149:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:2.0:1789129367.069160:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1789129367.069166:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2370:x1876037604595712:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:2.0:1789129367.069189:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2370:x1876037604595712:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 22us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129367.069212:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00080000:2.0:1789129367.069231:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789129367.069235:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789129367.069250:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129367.072443:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604595072 00000100:00100000:0.0:1789129367.072460:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604595072 00000100:00100000:0.0:1789129367.072527:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:0.0:1789129367.072537:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:2370:x1876037604595072:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129367.072780:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:2370:x1876037604595072:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 244us (4435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129367.072788:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 123 00000100:00100000:0.0:1789129367.301868:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626615296:0@lo:400:kworker.0 00000100:00100000:0.0:1789129367.301956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129367.302031:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789129367.302037:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626615424:0@lo:400:kworker.0 00000100:00100000:0.0:1789129367.302059:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129367.302084:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626615296 00000100:00100000:0.0:1789129367.302089:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626615296 00000100:00100000:0.0:1789129367.302139:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789129367.302148:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382822940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626615296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129367.302198:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382822940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626615296:12345-0@lo:400:kworker.0 Request processed in 50us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129367.302206:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789129367.302260:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626615296:0@lo:400:kworker.0 00000100:00100000:3.0:1789129367.302377:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382820f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626615040:0@lo:400:kworker.0 00000100:00100000:3.0:1789129367.302404:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129367.302430:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382822580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626615552:0@lo:400:kworker.0 00000100:00100000:3.0:1789129367.302445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129367.302457:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789129367.302460:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b3828212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626615168:0@lo:400:kworker.0 00000100:00100000:3.0:1789129367.302472:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129367.302481:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382821680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626615680:0@lo:400:kworker.0 00000100:00100000:3.0:1789129367.302492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129367.302513:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626615424 00000100:00100000:3.0:1789129367.302517:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626615424 00000100:00100000:3.0:1789129367.302542:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626615552 00000100:00100000:3.0:1789129367.302544:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626615552 00000100:00100000:3.0:1789129367.302557:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626615680 00000100:00100000:3.0:1789129367.302560:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626615680 00000100:00100000:3.0:1789129367.302572:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789129367.302576:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382820b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626615424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129367.302630:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382820b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876037626615424:12345-0@lo:400:kworker.0 Request processed in 53us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129367.302634:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789129367.302643:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789129367.302648:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626615552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129367.302668:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876037626615552:12345-0@lo:400:kworker.0 Request processed in 21us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129367.302672:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789129367.302678:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789129367.302682:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626615680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129367.302711:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876037626615680:12345-0@lo:400:kworker.0 Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129367.302715:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789129367.302735:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382821680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876037626615680:0@lo:400:kworker.0 00000100:00100000:3.0:1789129367.302741:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382822580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876037626615552:0@lo:400:kworker.0 00000100:00100000:1.0:1789129367.302861:0:16662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626615168 00000100:00100000:1.0:1789129367.302864:0:16662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626615168 00000100:00100000:1.0:1789129367.302906:0:16662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789129367.302913:0:16662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626615168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789129367.302964:0:16662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626615168:12345-0@lo:400:kworker.0 Request processed in 52us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129367.302971:0:16662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789129367.302996:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626615168:0@lo:400:kworker.0 00000100:00100000:0.0:1789129367.303109:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626615040 00000100:00100000:0.0:1789129367.303114:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626615040 00000100:00100000:0.0:1789129367.303150:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789129367.303157:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3308:x1876037626615040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789129367.303197:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5720450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3308:x1876037626615040:12345-0@lo:400:kworker.0 Request processed in 40us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129367.303204:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789129367.303255:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b3828203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876037626615424:0@lo:400:kworker.0 00000100:00080000:2.0:1789129367.303388:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789129367.303392:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789129367.303394:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789129367.303452:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626615808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789129367.303474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129367.303501:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626615808 00000100:00100000:0.0:1789129367.303505:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626615808 00000100:00100000:0.0:1789129367.303532:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789129367.303539:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626615808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789129367.303569:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789129367.303625:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626615808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129367.303630:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789129367.303652:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626615808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789129367.303759:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382820f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bfd76cf-bae1-432b-b8fe-46974cf010df:3308:1876037626615040:0@lo:400:kworker.0 00010000:00010000:2.0:1789129367.557993:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129368.399561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129368.399684:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604595968 00000100:00100000:3.0:1789129368.399692:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604595968 00000100:00100000:3.0:1789129368.399748:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:3.0:1789129368.399755:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:14645:x1876037604595968:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789129368.399774:0:14816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129368.399796:0:14816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad36 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.399867:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce573d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.399881:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce573d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.399896:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce573d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.399913:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.399920:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.399926:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.400804:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce574b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.400819:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce574b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.400829:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce574b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129368.400915:0:14816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789129368.400920:0:14816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129368.401015:0:14816:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce574b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401028:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce573d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401035:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce573d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401041:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce573d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401047:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129368.401052:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce573d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401058:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce573d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401401:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:3.0:1789129368.401410:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129368.401415:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce573d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401420:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce573d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401431:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401434:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5744 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401438:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401441:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129368.401443:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401446:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5744 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401451:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90b4909bda00) 00010000:00010000:3.0:1789129368.401452:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129368.401453:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5744 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401456:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5744 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401487:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad36 expref: 8 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401505:0:14816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2400/0x5c74554e47ce574b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad36 expref: 7 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.401510:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:3.0:1789129368.401512:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789129368.401513:0:14816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2400, rc 0) 00000100:00100000:2.0:1789129368.405439:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:14645:x1876037604595968:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 5670us (5871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129368.405451:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:2.0:1789129368.409007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129368.409111:0:16812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604596224 00000100:00100000:0.0:1789129368.409121:0:16812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604596224 00000100:00100000:0.0:1789129368.409190:0:16812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:0.0:1789129368.409202:0:16812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:14645:x1876037604596224:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789129368.409240:0:16812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129368.409277:0:16812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce5752 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad3d expref: -99 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.409375:0:16812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5759 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.409404:0:16812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5759 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.409416:0:16812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5759 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.409433:0:16812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce5760 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.409439:0:16812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce5760 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.409445:0:16812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce5760 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.411185:0:16812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce5767 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.411210:0:16812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce5767 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.411233:0:16812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce5767 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129368.411444:0:16812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1789129368.414455:0:16812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5759 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414473:0:16812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5759 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414480:0:16812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5759 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414502:0:16812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129368.414507:0:16812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5759 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414515:0:16812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5759 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414533:0:16812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90b4909bdf00) 00010000:00010000:0.0:1789129368.414537:0:16812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129368.414543:0:16812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5759 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414550:0:16812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5759 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414565:0:16812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce5760 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414571:0:16812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce5760 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414577:0:16812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce5760 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414582:0:16812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129368.414585:0:16812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce5760 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414590:0:16812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce5760 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414652:0:16812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90b4976b8c00) 00010000:00010000:0.0:1789129368.414655:0:16812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129368.414659:0:16812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce5760 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.414664:0:16812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce5760 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.415202:0:16812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362600/0x5c74554e47ce5752 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad3d expref: 10 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.415231:0:16812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363200/0x5c74554e47ce5767 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad3d expref: 9 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.415239:0:16812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:0.0:1789129368.415241:0:16812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789129368.415388:0:16812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363200, rc 0) 00000100:00100000:0.0:1789129368.415475:0:16812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:14645:x1876037604596224:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 6274us (6475us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789129368.415485:0:16812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 16 00000100:00100000:1.0:1789129368.421122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129368.421658:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604596352 00000100:00100000:0.0:1789129368.421669:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604596352 00000100:00100000:0.0:1789129368.421737:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:0.0:1789129368.421750:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:14645:x1876037604596352:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789129368.421875:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:14645:x1876037604596352:12345-192.168.201.39@tcp:59:lhsmtool_posix.0 Request processed in 128us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129368.421883:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:3.0:1789129368.491257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.494476:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604596480 00000100:00100000:2.0:1789129368.494493:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604596480 00000100:00100000:2.0:1789129368.494583:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1789129368.494653:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:14651:x1876037604596480:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129368.494679:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129368.494702:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce5775 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad44 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.494767:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce577c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.494782:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce577c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.494796:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce577c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.494811:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce5783 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.494818:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce5783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.494826:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce5783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495095:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce577c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495104:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce577c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495110:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce577c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495126:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129368.495131:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce577c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495138:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce577c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495150:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:2.0:1789129368.495153:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129368.495157:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce577c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495163:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce577c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495175:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce5783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495181:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce5783 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495186:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce5783 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495191:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129368.495193:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce5783 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495199:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce5783 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495229:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90b482b51600) 00010000:00010000:2.0:1789129368.495232:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129368.495235:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce5783 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495241:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce5783 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495286:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce5775 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad44 expref: 10 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495297:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:2.0:1789129368.495300:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129368.495303:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce5775 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad44 expref: 10 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.495312:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285b000, rc 0) 00000100:00100000:2.0:1789129368.495383:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:14651:x1876037604596480:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 735us (4142us total) trans 0 rc 301/301 00000100:00100000:2.0:1789129368.495391:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:1.0:1789129368.501738:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129368.501873:0:14825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604596608 00000100:00100000:3.0:1789129368.501888:0:14825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604596608 00000100:00100000:3.0:1789129368.501965:0:14825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1789129368.501982:0:14825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:14651:x1876037604596608:12345-192.168.201.39@tcp:700:lfs.0 00000100:00100000:3.0:1789129368.502104:0:14825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:14651:x1876037604596608:12345-192.168.201.39@tcp:700:lfs.0 Request processed in 126us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129368.502114:0:14825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:1.0:1789129368.505838:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129368.505969:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604596864 00000100:00100000:0.0:1789129368.505984:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604596864 00000100:00100000:0.0:1789129368.506062:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:0.0:1789129368.506074:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:14651:x1876037604596864:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:0.0:1789129368.506156:0:14817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129368.506204:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363400/0x5c74554e47ce56b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aacbf expref: 9 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.506239:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:0.0:1789129368.506246:0:14817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129368.506695:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.506713:0:14817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad21 expref: 5 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.506723:0:14817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.506769:0:14817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad21 expref: 5 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.506800:0:14817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad21 expref: 5 pid: 14818 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129368.506819:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382823480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14817:1876037626615936:192.168.201.39@tcp:104: 00000100:00100000:0.0:1789129368.506941:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4897df3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789129368.514449:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129368.514737:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382823480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14817:1876037626615936:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129368.514776:0:14817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129368.514915:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604596992 00000100:00100000:1.0:1789129368.514926:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604596992 00010000:00010000:1.0:1789129368.514982:0:14801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad21 expref: 6 pid: 14818 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129368.515038:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:1.0:1789129368.515052:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382823840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2369:x1876037604596992:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129368.515074:0:14801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129368.515094:0:14801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad21 expref: 6 pid: 14818 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.515131:0:14801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad21 expref: 6 pid: 14818 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.515162:0:14801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce56f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad21 expref: 6 pid: 14818 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.515183:0:14801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:1.0:1789129368.515189:0:14801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.515202:0:14801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.515211:0:14801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.515251:0:14801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129368.515332:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382823840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2369:x1876037604596992:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 282us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129368.515341:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00010000:00010000:3.0:1789129368.516008:0:14817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.516021:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.516053:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.516079:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.516089:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129368.517844:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789129368.517869:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.517880:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.517888:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.517896:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:3.0:1789129368.517901:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.517910:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.517929:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b4976b8d00) 00010000:00010000:3.0:1789129368.517932:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789129368.517938:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.517945:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363600/0x5c74554e47ce578a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789129368.517983:0:14817:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004e39e56b reply state 000000009823d761 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129368.517994:0:14817:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789129368.518128:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bae7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+10:14651:x1876037604596864:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 12050us (12302us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789129368.518138:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00010000:00010000:1.0:1789129368.527932:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.527959:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.527968:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.528000:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3600 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129368.528005:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.528015:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.528036:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90b4909bda00) 00010000:00010000:1.0:1789129368.528039:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129368.528045:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.528052:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3600/0x5c74554e47ce5791 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.581957:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129368.630720:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.630885:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604597120 00000100:00100000:2.0:1789129368.630899:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604597120 00000100:00100000:2.0:1789129368.630980:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:2.0:1789129368.630992:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382820780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:14659:x1876037604597120:12345-192.168.201.39@tcp:101:lctl.0 00010000:00010000:2.0:1789129368.631025:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129368.631057:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce5798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad4b expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.631189:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce579f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.631207:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce579f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.631230:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce579f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129368.631314:0:14818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789129368.631317:0:14818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129368.631377:0:14818:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce579f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.631414:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce5798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad4b expref: 11 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.631440:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a600/0x5c74554e47ce579f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad4b expref: 10 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.631452:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:2.0:1789129368.631455:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789129368.631461:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285a600, rc 0) 00000100:00100000:2.0:1789129368.631556:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382820780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+10:14659:x1876037604597120:12345-192.168.201.39@tcp:101:lctl.0 Request processed in 566us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129368.631565:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1789129368.664029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.664152:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604597248 00000100:00100000:2.0:1789129368.664175:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604597248 00000100:00100000:3.0:1789129368.664458:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:3.0:1789129368.664475:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382821e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:14660:x1876037604597248:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129368.664506:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129368.664535:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce57a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad52 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.664666:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce57ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.664684:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce57ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.664699:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce57ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129368.664780:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789129368.664785:0:14817:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129368.664816:0:14817:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce57ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.664846:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce57a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad52 expref: 7 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.664885:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3000/0x5c74554e47ce57ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad52 expref: 6 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.664895:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:3.0:1789129368.664899:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789129368.664903:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf3000, rc 0) 00000100:00100000:3.0:1789129368.664982:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382821e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:14660:x1876037604597248:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 513us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129368.664989:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1789129368.679822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.680028:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604597376 00000100:00100000:2.0:1789129368.680043:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604597376 00000100:00100000:2.0:1789129368.680127:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:2.0:1789129368.680141:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:14660:x1876037604597376:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129368.680183:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129368.680222:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad59 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.680312:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.680333:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.680347:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.680365:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.680372:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.680378:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.680883:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce57c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.680893:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce57c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.680924:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce57c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129368.680974:0:14818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789129368.680978:0:14818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129368.681013:0:14818:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce57c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681029:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681036:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681043:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681049:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129368.681054:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681062:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681077:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:2.0:1789129368.681080:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129368.681086:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681091:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681116:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681122:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681128:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681133:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285ae00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129368.681136:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681144:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681152:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90b482b51900) 00010000:00010000:2.0:1789129368.681155:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129368.681170:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681178:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681239:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad59 expref: 8 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681255:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce57c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad59 expref: 7 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.681276:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789129368.681278:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789129368.681281:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285b200, rc 0) 00000100:00100000:2.0:1789129368.681393:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+7:14660:x1876037604597376:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1253us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129368.681403:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:1.0:1789129368.690954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129368.691762:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604597632 00000100:00100000:3.0:1789129368.691778:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604597632 00000100:00100000:3.0:1789129368.691875:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:3.0:1789129368.691888:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4bacd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+7:14660:x1876037604597632:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:3.0:1789129368.691918:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129368.691948:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce57d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad60 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129368.692119:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789129368.692490:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce57d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad60 expref: 9 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.692508:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:3.0:1789129368.692511:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789129368.692517:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce57d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad60 expref: 9 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.692557:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2800, rc 0) 00000100:00100000:0.0:1789129368.697717:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4bacd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+8:14660:x1876037604597632:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 5807us (6752us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789129368.697741:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:0.0:1789129368.703538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.703658:0:16812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604597888 00000100:00100000:2.0:1789129368.703674:0:16812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604597888 00000100:00100000:2.0:1789129368.703760:0:16812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:2.0:1789129368.703774:0:16812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95fac8e8-2023-47db-8e7f-1db7b77a81bc+8:14660:x1876037604597888:12345-192.168.201.39@tcp:36:lfs.0 00010000:00010000:2.0:1789129368.703866:0:16812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129368.703906:0:16812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce57c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad59 expref: 8 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.703930:0:16812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789129368.703948:0:16812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789129368.703981:0:16812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.703999:0:16812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.704011:0:16812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789129368.704345:0:16812:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000f7a5548 reply state 00000000b6af0ea4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129368.704379:0:16812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789129368.704395:0:16812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1789129368.704511:0:16812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95fac8e8-2023-47db-8e7f-1db7b77a81bc+9:14660:x1876037604597888:12345-192.168.201.39@tcp:36:lfs.0 Request processed in 739us (989us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789129368.704519:0:16812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00010000:00010000:0.0:1789129368.706729:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.706752:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.706761:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.706768:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285b000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129368.706774:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.706783:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.706803:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90b482b51900) 00010000:00010000:0.0:1789129368.706807:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789129368.706813:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.706820:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce57de lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129368.707513:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.707649:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604598144 00000100:00100000:2.0:1789129368.707663:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604598144 00000100:00100000:2.0:1789129368.707732:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:2.0:1789129368.707744:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382820f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+8:14660:x1876037604598144:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789129368.708133:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382820f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+9:14660:x1876037604598144:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 389us (625us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789129368.708143:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1789129368.714706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.714809:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604598400 00000100:00100000:2.0:1789129368.714825:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604598400 00000100:00100000:2.0:1789129368.714923:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:2.0:1789129368.714938:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95fac8e8-2023-47db-8e7f-1db7b77a81bc+9:14660:x1876037604598400:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129368.714974:0:14816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129368.715002:0:14816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce57e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad67 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715112:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715131:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715147:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715186:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715195:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715204:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129368.715426:0:14816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789129368.715568:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715578:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715585:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715593:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285ae00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129368.715599:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715657:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715673:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:2.0:1789129368.715677:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129368.715683:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715704:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce57ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715720:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715727:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715732:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715738:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129368.715741:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715748:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715756:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90b482b51d00) 00010000:00010000:2.0:1789129368.715758:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129368.715761:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715766:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce57f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715819:0:14816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce57e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad67 expref: 11 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715844:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:2.0:1789129368.715847:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789129368.715851:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce57e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad67 expref: 11 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.715861:0:14816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285b200, rc 0) 00000100:00100000:2.0:1789129368.715943:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95fac8e8-2023-47db-8e7f-1db7b77a81bc+10:14660:x1876037604598400:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 1009us (1252us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789129368.715953:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 25 00000100:00100000:1.0:1789129368.718696:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.718863:0:16812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604598528 00000100:00100000:2.0:1789129368.718879:0:16812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604598528 00000100:00100000:2.0:1789129368.718958:0:16812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:2.0:1789129368.718971:0:16812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95fac8e8-2023-47db-8e7f-1db7b77a81bc+10:14660:x1876037604598528:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:2.0:1789129368.719004:0:16812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129368.719035:0:16812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5801 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad6e expref: -99 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.719178:0:16812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.719198:0:16812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.719223:0:16812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129368.719302:0:16812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789129368.719333:0:16812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129368.719369:0:16812:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.719409:0:16812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5801 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad6e expref: 12 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.719433:0:16812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad6e expref: 11 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.719443:0:16812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90b482b51300) 00010000:00010000:2.0:1789129368.719447:0:16812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789129368.719451:0:16812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285aa00, rc 0) 00000100:00100000:2.0:1789129368.719539:0:16812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95fac8e8-2023-47db-8e7f-1db7b77a81bc+11:14660:x1876037604598528:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 571us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129368.719548:0:16812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 26 00000100:00100000:1.0:1789129368.723292:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.723590:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604598656 00000100:00100000:2.0:1789129368.723624:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604598656 00000100:00100000:2.0:1789129368.723809:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:2.0:1789129368.723824:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+11:14660:x1876037604598656:12345-192.168.201.39@tcp:37:lfs.0 00000100:00100000:2.0:1789129368.730113:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+11:14660:x1876037604598656:12345-192.168.201.39@tcp:37:lfs.0 Request processed in 6274us (6827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129368.730133:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:0.0:1789129368.745730:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129368.745937:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604598912 00000100:00100000:3.0:1789129368.745952:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604598912 00000100:00100000:3.0:1789129368.746089:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1789129368.746103:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95fac8e8-2023-47db-8e7f-1db7b77a81bc+11:14660:x1876037604598912:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129368.746559:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95fac8e8-2023-47db-8e7f-1db7b77a81bc+12:14660:x1876037604598912:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 458us (844us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789129368.746568:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:1.0:1789129368.823718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.823815:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604599040 00000100:00100000:2.0:1789129368.823834:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604599040 00000100:00100000:2.0:1789129368.823925:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:2.0:1789129368.823938:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+10:14666:x1876037604599040:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789129368.823969:0:14816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129368.824018:0:14816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce580f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad75 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824108:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce5816 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824126:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce5816 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824140:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce5816 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824156:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce581d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824164:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce581d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824170:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce581d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824352:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce5824 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824360:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce5824 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824367:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce5824 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129368.824408:0:14816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1789129368.824413:0:14816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129368.824469:0:14816:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce5824 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824493:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce5816 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824500:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce5816 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824508:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce5816 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824515:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285b200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129368.824521:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce5816 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824531:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce5816 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824546:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:2.0:1789129368.824550:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129368.824556:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce5816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824562:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce5816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824577:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce581d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824583:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce581d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824588:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce581d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824656:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129368.824661:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce581d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824667:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce581d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824676:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff90b482b51d00) 00010000:00010000:2.0:1789129368.824678:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129368.824681:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce581d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824686:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce581d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824731:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce580f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad75 expref: 12 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824745:0:14816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ae00/0x5c74554e47ce5824 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad75 expref: 11 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.824753:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90b482b51300) 00010000:00010000:2.0:1789129368.824755:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789129368.824758:0:14816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285ae00, rc 0) 00000100:00100000:2.0:1789129368.824837:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+11:14666:x1876037604599040:12345-192.168.201.39@tcp:101:bash.0 Request processed in 901us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129368.824846:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 27 00000100:00100000:1.0:1789129368.829685:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129368.829938:0:16812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604599296 00000100:00100000:2.0:1789129368.829968:0:16812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604599296 00000100:00100000:2.0:1789129368.830092:0:16812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 28 00000100:00100000:2.0:1789129368.830105:0:16812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+11:14666:x1876037604599296:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:2.0:1789129368.830138:0:16812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129368.830168:0:16812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce582b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad7c expref: -99 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.830408:0:16812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.830430:0:16812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad6e expref: 11 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.830443:0:16812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.830493:0:16812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad6e expref: 11 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.830521:0:16812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad6e expref: 11 pid: 16812 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129368.830538:0:16812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16812:1876037626616064:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129368.830703:0:16812:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4a7e1a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789129368.838416:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129368.838542:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604599424 00000100:00100000:1.0:1789129368.838556:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604599424 00010000:00010000:1.0:1789129368.838645:0:14803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad6e expref: 12 pid: 16812 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129368.838692:0:16812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498ac6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16812:1876037626616064:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129368.838697:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:1.0:1789129368.838730:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+12:2369:x1876037604599424:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129368.838731:0:16812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.838752:0:14803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129368.838761:0:14803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad6e expref: 12 pid: 16812 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.838785:0:14803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad6e expref: 12 pid: 16812 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.838829:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce5808 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad6e expref: 12 pid: 16812 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.839739:0:14803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90b482b51300) 00010000:00010000:1.0:1789129368.839746:0:14803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.839759:0:14803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.839769:0:14803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.840201:0:14803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129368.840301:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+11:2369:x1876037604599424:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 1566us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129368.840314:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00010000:00010000:3.0:1789129368.840427:0:16812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.840437:0:16812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.840469:0:16812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.840482:0:16812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.840491:0:16812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843160:0:16812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843184:0:16812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843218:0:16812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129368.843236:0:16812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789129368.843271:0:16812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843277:0:16812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843282:0:16812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843286:0:16812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285b400 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129368.843290:0:16812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843295:0:16812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843306:0:16812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90b482b51300) 00010000:00010000:2.0:1789129368.843309:0:16812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129368.843313:0:16812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843318:0:16812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce5832 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789129368.843329:0:16812:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000dcbf6549 reply state 00000000729b6b04 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129368.843345:0:16812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789129368.843388:0:16812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce582b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad7c expref: 14 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843400:0:16812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad7c expref: 13 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129368.843406:0:16812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789129368.843408:0:16812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789129368.843409:0:16812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285ac00, rc 0) 00000100:00100000:2.0:1789129368.843496:0:16812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+14:14666:x1876037604599296:12345-192.168.201.39@tcp:101:bash.0 Request processed in 13394us (13828us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789129368.843506:0:16812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 28 00010000:00010000:1.0:1789129368.851755:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.851778:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.851807:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.851814:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129368.851820:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.851829:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.851862:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff90b4909bde00) 00010000:00010000:1.0:1789129368.851865:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129368.851872:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129368.851878:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5839 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129368.859712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129368.859864:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604599552 00000100:00100000:3.0:1789129368.859899:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604599552 00000100:00100000:3.0:1789129368.859988:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:3.0:1789129368.860002:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+13:14666:x1876037604599552:12345-192.168.201.39@tcp:101:bash.0 00010000:00010000:3.0:1789129368.860037:0:14816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789129368.860071:0:14816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce584e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad83 expref: -99 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.860176:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.860195:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.860222:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129368.860293:0:14816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789129368.860299:0:14816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789129368.860449:0:14816:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.860460:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.860486:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf3c00/0x5c74554e47ce584e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad83 expref: 15 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.860504:0:14816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad83 expref: 14 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129368.860511:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:3.0:1789129368.860519:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789129368.860523:0:14816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b488bf2800, rc 0) 00000100:00100000:3.0:1789129368.860663:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+14:14666:x1876037604599552:12345-192.168.201.39@tcp:101:bash.0 Request processed in 602us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129368.860674:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 29 00000100:00100000:2.0:1789129368.864445:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129368.864679:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604599808 00000100:00100000:3.0:1789129368.864695:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604599808 00000100:00100000:3.0:1789129368.864770:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1789129368.864782:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+14:14666:x1876037604599808:12345-192.168.201.39@tcp:35:bash.0 00000100:00100000:3.0:1789129368.865518:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+15:14666:x1876037604599808:12345-192.168.201.39@tcp:35:bash.0 Request processed in 733us (1115us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789129368.865530:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1789129368.969783:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129368.969913:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604600064 00000100:00100000:0.0:1789129368.969931:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604600064 00000100:00100000:0.0:1789129368.970003:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:0.0:1789129368.970012:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+15:14676:x1876037604600064:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129368.970050:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129368.970083:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce585c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad8a expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129368.970262:0:14818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1789129368.970406:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce585c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad8a expref: 17 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.970422:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90b482b51600) 00010000:00010000:0.0:1789129368.970425:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129368.970429:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce585c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad8a expref: 17 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129368.970444:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363c00, rc 0) 00000100:00100000:0.0:1789129368.970526:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+16:14676:x1876037604600064:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 514us (757us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789129368.970534:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 30 00000100:00100000:0.0:1789129368.976132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129368.976218:0:14820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604600320 00000100:00100000:3.0:1789129368.976231:0:14820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604600320 00000100:00100000:3.0:1789129368.976371:0:14820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789129368.976387:0:14820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+16:14676:x1876037604600320:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:3.0:1789129368.976858:0:14820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+17:14676:x1876037604600320:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 475us (739us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789129368.976869:0:14820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:1.0:1789129369.023107:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129369.023394:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604600576 00000100:00100000:0.0:1789129369.023409:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604600576 00000100:00080000:2.0:1789129369.023518:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129369.023525:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:0.0:1789129369.023540:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+17:14679:x1876037604600576:12345-192.168.201.39@tcp:101:lfs.0 00010000:00010000:0.0:1789129369.023656:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129369.023689:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce586a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad91 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.023834:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce5871 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.023854:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce5871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.023874:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce5871 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129369.023888:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789129369.024127:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce586a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad91 expref: 20 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.024144:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce5871 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad91 expref: 19 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.024152:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:0.0:1789129369.024155:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129369.024160:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490362c00, rc 0) 00000100:00100000:0.0:1789129369.024259:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+19:14679:x1876037604600576:12345-192.168.201.39@tcp:101:lfs.0 Request processed in 723us (1169us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789129369.024268:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 31 00000100:00100000:1.0:1789129369.028215:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129369.028373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129369.028456:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604600832 00000100:00100000:2.0:1789129369.028474:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604600832 00000100:00100000:2.0:1789129369.028735:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789129369.028749:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+19:2369:x1876037604600832:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129369.028772:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129369.028985:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce5871 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad91 expref: 19 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.029011:0:14802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789129369.029040:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129369.029173:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+18:2369:x1876037604600832:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 427us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129369.029183:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:0.0:1789129369.032527:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604600704 00000100:00100000:0.0:1789129369.032548:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604600704 00000100:00100000:0.0:1789129369.032657:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:0.0:1789129369.032691:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+18:14679:x1876037604600704:12345-192.168.201.39@tcp:54:lfs.0 00010000:00010000:0.0:1789129369.032795:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce587f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.032820:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce587f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.032835:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce587f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.032871:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce587f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.032878:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce587f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.032886:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce587f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.032894:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362e00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129369.032899:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce587f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.032907:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce587f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.032922:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:0.0:1789129369.032924:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789129369.032928:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce587f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.032933:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce587f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129369.033453:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+18:14679:x1876037604600704:12345-192.168.201.39@tcp:54:lfs.0 Request processed in 761us (5260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129369.033463:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1789129369.041170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129369.041575:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604601088 00000100:00100000:2.0:1789129369.041590:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604601088 00000100:00100000:2.0:1789129369.041703:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789129369.041716:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+18:14679:x1876037604601088:12345-192.168.201.39@tcp:35:lfs.0 00000100:00100000:2.0:1789129369.042054:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+19:14679:x1876037604601088:12345-192.168.201.39@tcp:35:lfs.0 Request processed in 339us (909us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789129369.042063:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000040:00080000:0.0:1789129369.286360:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789129369.348592:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129369.348744:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604601344 00000100:00100000:0.0:1789129369.348762:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604601344 00000100:00100000:0.0:1789129369.349170:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:0.0:1789129369.349185:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+19:14710:x1876037604601344:12345-192.168.201.39@tcp:101:cat.0 00010000:00010000:0.0:1789129369.349237:0:14817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789129369.349275:0:14817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5886 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad98 expref: -99 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.349445:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce588d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.349463:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce588d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.349479:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce588d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789129369.349495:0:14817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789129369.349730:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362e00/0x5c74554e47ce5886 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad98 expref: 22 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.349752:0:14817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce588d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad98 expref: 21 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129369.349785:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:0.0:1789129369.349957:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789129369.349964:0:14817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b490363c00, rc 0) 00000100:00100000:0.0:1789129369.350164:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+21:14710:x1876037604601344:12345-192.168.201.39@tcp:101:cat.0 Request processed in 982us (1592us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789129369.350175:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:1.0:1789129369.356782:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129369.356855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129369.356943:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604601728 00000100:00100000:3.0:1789129369.356955:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604601728 00000100:00100000:3.0:1789129369.357040:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1789129369.357052:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+21:2369:x1876037604601728:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129369.357074:0:14803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129369.357108:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490363c00/0x5c74554e47ce588d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad98 expref: 21 pid: 14817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.357149:0:14803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:3.0:1789129369.357165:0:14803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129369.357239:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+20:2369:x1876037604601728:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 189us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129369.357247:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:2.0:1789129369.357779:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604601600 00000100:00100000:2.0:1789129369.357786:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604601600 00000100:00100000:2.0:1789129369.357835:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:2.0:1789129369.357843:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+20:14710:x1876037604601600:12345-192.168.201.39@tcp:35:cat.0 00000100:00100000:2.0:1789129369.358253:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+21:14710:x1876037604601600:12345-192.168.201.39@tcp:35:cat.0 Request processed in 410us (1487us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789129369.358262:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 8 00000100:00100000:1.0:1789129369.416798:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129369.416928:0:16812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604601984 00000100:00100000:2.0:1789129369.416943:0:16812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604601984 00000100:00100000:2.0:1789129369.417127:0:16812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:2.0:1789129369.417140:0:16812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+21:14716:x1876037604601984:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789129369.417187:0:16812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129369.417233:0:16812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce589b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aad9f expref: -99 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.417384:0:16812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.417401:0:16812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad7c expref: 22 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.417407:0:16812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad83 expref: 22 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.417413:0:16812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.417453:0:16812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad83 expref: 22 pid: 14816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.417479:0:16812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad83 expref: 22 pid: 14816 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129369.417494:0:16812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16812:1876037626616192:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129369.417676:0:16812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad7c expref: 22 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.417685:0:16812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad7c expref: 22 pid: 16812 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129369.417694:0:16812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b38274bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16812:1876037626616320:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129369.417734:0:16812:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49013b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789129369.421331:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129369.421511:0:16812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16812:1876037626616192:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129369.421524:0:16812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b38274bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16812:1876037626616320:192.168.201.39@tcp:104: 00010000:00010000:2.0:1789129369.421561:0:16812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129369.421693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129369.422242:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604602112 00000100:00100000:1.0:1789129369.422253:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604602112 00010000:00010000:1.0:1789129369.422301:0:14802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad83 expref: 23 pid: 14816 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129369.422368:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604602240 00000100:00100000:3.0:1789129369.422374:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604602240 00010000:00010000:3.0:1789129369.422394:0:14803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad7c expref: 24 pid: 16812 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129369.422457:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:3.0:1789129369.422466:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b485c57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:2369:x1876037604602112:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129369.422483:0:14803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129369.422490:0:14803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad83 expref: 24 pid: 14816 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422509:0:14803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad83 expref: 24 pid: 14816 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422532:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce5855 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad83 expref: 24 pid: 14816 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422548:0:14803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:3.0:1789129369.422554:0:14803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422578:0:14803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422587:0:14803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129369.422686:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b485c57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+23:2369:x1876037604602112:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 220us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129369.422693:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:3.0:1789129369.422754:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 12 00000100:00100000:3.0:1789129369.422759:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382822580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+22:2369:x1876037604602240:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129369.422766:0:14803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129369.422771:0:14803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad7c expref: 22 pid: 16812 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422783:0:14803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad7c expref: 22 pid: 16812 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422796:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ac00/0x5c74554e47ce5840 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aad7c expref: 22 pid: 16812 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422808:0:14803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:3.0:1789129369.422812:0:14803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422820:0:14803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422901:0:14803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.422938:0:14803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789129369.422960:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382822580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+21:2369:x1876037604602240:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 199us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129369.422967:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 12 00010000:00010000:3.0:1789129369.423009:0:16812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.423016:0:16812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789129369.423039:0:16812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789129369.423281:0:16812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce589b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad9f expref: 22 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.423299:0:16812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b200/0x5c74554e47ce58a2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aad9f expref: 21 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.423306:0:16812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:3.0:1789129369.423309:0:16812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789129369.423312:0:16812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285b200, rc 0) 00000100:00100000:3.0:1789129369.423340:0:16812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+21:14716:x1876037604601984:12345-192.168.201.39@tcp:101:dd.0 Request processed in 6204us (6799us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789129369.423348:0:16812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 34 00000100:00100000:0.0:1789129369.425699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129369.425948:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604602496 00000100:00100000:1.0:1789129369.425961:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604602496 00000100:00100000:1.0:1789129369.426034:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 35 00000100:00100000:1.0:1789129369.426046:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382821680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+21:14716:x1876037604602496:12345-192.168.201.39@tcp:36:dd.0 00010000:00010000:1.0:1789129369.426422:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129369.426445:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129369.426458:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789129369.426524:0:14816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789129369.426556:0:14816:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f4cbedd3 reply state 0000000079094cc0 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129369.426567:0:14816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789129369.427091:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382821680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14716:x1876037604602496:12345-192.168.201.39@tcp:36:dd.0 Request processed in 1043us (1402us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789129369.427100:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 35 00000020:00080000:1.0:1789129369.427107:0:14816:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789129369.430036:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789129369.430449:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.430467:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.430475:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.430481:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129369.430486:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.430494:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.430514:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789129369.430518:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129369.430524:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.430530:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031a00/0x5c74554e47ce58b0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129369.430705:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604602624 00000100:00100000:1.0:1789129369.430719:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604602624 00000100:00100000:1.0:1789129369.430802:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:1.0:1789129369.430814:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+23:14716:x1876037604602624:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:1.0:1789129369.430856:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129369.430880:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aada6 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129369.430981:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aada6 expref: 24 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129369.430999:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58b7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aada6 expref: 24 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129369.431023:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789129369.431026:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789129369.431029:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031800, rc 0) 00000100:00100000:1.0:1789129369.431783:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14716:x1876037604602624:12345-192.168.201.39@tcp:101:dd.0 Request processed in 966us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129369.431801:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 36 00000100:00100000:3.0:1789129369.444480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129369.444658:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604602880 00000100:00100000:1.0:1789129369.444671:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604602880 00000100:00100000:1.0:1789129369.444763:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:1.0:1789129369.444776:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14716:x1876037604602880:12345-192.168.201.39@tcp:103:dd.0 00010000:00010000:1.0:1789129369.444799:0:14802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129369.444850:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aada6 expref: 24 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129369.444879:0:14802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789129369.444887:0:14802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129369.444973:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b22d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+23:14716:x1876037604602880:12345-192.168.201.39@tcp:103:dd.0 Request processed in 199us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129369.444983:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:0.0:1789129369.447747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129369.447868:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604603008 00000100:00100000:3.0:1789129369.447882:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604603008 00000100:00100000:3.0:1789129369.447976:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:3.0:1789129369.447988:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382823c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+23:14716:x1876037604603008:12345-192.168.201.39@tcp:58:dd.0 00010000:00010000:3.0:1789129369.448124:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.448160:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129369.448176:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789129369.449123:0:14817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789129369.449344:0:14817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789129369.449434:0:14817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789129369.449576:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382823c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+23:14716:x1876037604603008:12345-192.168.201.39@tcp:58:dd.0 Request processed in 1585us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129369.449590:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 37 00000100:00100000:0.0:1789129369.452479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129369.452630:0:16812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604603136 00000100:00100000:2.0:1789129369.452663:0:16812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604603136 00000100:00100000:2.0:1789129369.452749:0:16812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 38 00000100:00100000:2.0:1789129369.452762:0:16812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3828221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+23:14716:x1876037604603136:12345-192.168.201.39@tcp:101:dd.0 00010000:00010000:2.0:1789129369.452799:0:16812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129369.452848:0:16812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce58c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aadad expref: -99 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.452938:0:16812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.452952:0:16812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce58c5 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadad expref: 24 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.452977:0:16812:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.452993:0:16812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce58c5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadad expref: 24 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.453011:0:16812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789129369.453014:0:16812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789129369.453019:0:16812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce58c5 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadad expref: 24 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129369.453028:0:16812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285aa00, rc 0) 00000100:00100000:2.0:1789129369.453107:0:16812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3828221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14716:x1876037604603136:12345-192.168.201.39@tcp:101:dd.0 Request processed in 348us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129369.453115:0:16812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 38 00010000:00010000:3.0:1789129369.608973:0:16944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789129370.309999:0:14851:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789129370.310017:0:14851:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789129370.310070:0:14851:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789129370.310078:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789129370.310278:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382823840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14851:1876037626616448:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789129370.310432:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4897df3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129370.326660:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382823840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14851:1876037626616448:192.168.201.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789129370.333486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129370.333881:0:14827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604603264 00000100:00100000:3.0:1789129370.333897:0:14827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604603264 00000100:00100000:3.0:1789129370.333977:0:14827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1789129370.334098:0:14827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382820f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14717:x1876037604603264:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789129370.334290:0:14827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382820f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14717:x1876037604603264:12345-192.168.201.39@tcp:900:lhsmtool_posix.0 Request processed in 302us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129370.334300:0:14827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:0.0:1789129370.340107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129370.340577:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604603392 00000100:00100000:3.0:1789129370.340592:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604603392 00000100:00100000:2.0:1789129370.340956:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:2.0:1789129370.340971:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b382823840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14717:x1876037604603392:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789129370.341028:0:14817:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789129370.341192:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b382823840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14717:x1876037604603392:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 215us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129370.341201:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 39 00000100:00100000:0.0:1789129370.349341:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.358117:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604603520 00000100:00100000:1.0:1789129370.358152:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604603520 00000100:00100000:1.0:1789129370.358275:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:1.0:1789129370.358288:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14717:x1876037604603520:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789129370.358394:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58cc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358417:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358434:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358452:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358459:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358466:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358511:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358521:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358528:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129370.358578:0:14816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789129370.358623:0:14816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789129370.358647:0:14816:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358663:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58cc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358670:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58cc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358678:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58cc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358685:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129370.358690:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58cc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358698:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58cc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358712:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789129370.358715:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129370.358722:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358730:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358748:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358754:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58d3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358771:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358776:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129370.358780:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358787:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58d3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.358795:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff90b4a2a08c00) 00010000:00010000:1.0:1789129370.358798:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129370.358801:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58d3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.360943:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.361225:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.361236:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.361245:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.361252:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129370.361258:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.361296:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.361317:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789129370.361321:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129370.361329:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.361336:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129370.362273:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14717:x1876037604603520:12345-192.168.201.39@tcp:34:lhsmtool_posix.0 Request processed in 3973us (12932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129370.362290:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 40 00000100:00100000:0.0:1789129370.372148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.372381:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604603776 00000100:00100000:1.0:1789129370.372394:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604603776 00000100:00100000:1.0:1789129370.372478:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:1.0:1789129370.372491:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4a788a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+24:14717:x1876037604603776:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129370.372523:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129370.372561:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aadb4 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.372775:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58e8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.372796:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.372823:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789129370.372862:0:14818:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789129370.373162:0:14818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58e8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.373172:0:14818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58e8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.373189:0:14818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.373197:0:14818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129370.373202:0:14818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58e8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.373210:0:14818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58e8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.373226:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:1.0:1789129370.373229:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789129370.373234:0:14818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58e8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.373241:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce58e8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.373300:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58e1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadb4 expref: 26 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.373312:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90b4976b8900) 00010000:00010000:1.0:1789129370.373314:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789129370.373326:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce58e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadb4 expref: 26 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.373338:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030a00, rc 0) 00000100:00100000:1.0:1789129370.373414:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4a788a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+25:14717:x1876037604603776:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 925us (1291us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1789129370.373423:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 41 00000100:00100000:2.0:1789129370.373927:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789129370.373949:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b498b21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626616576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129370.374030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129370.377393:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626616576 00000100:00100000:3.0:1789129370.377418:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626616576 00000100:00100000:3.0:1789129370.377517:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789129370.377532:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626616576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789129370.377592:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789129370.377704:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876037626616576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (3673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129370.377712:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789129370.378644:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129370.378999:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b498b21e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876037626616576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789129370.379527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129370.380052:0:16812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604603904 00000100:00100000:3.0:1789129370.380064:0:16812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604603904 00000100:00100000:3.0:1789129370.380162:0:16812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:3.0:1789129370.380174:0:16812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+25:14717:x1876037604603904:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789129370.380232:0:16812:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789129370.380376:0:16812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+25:14717:x1876037604603904:12345-192.168.201.39@tcp:53:lhsmtool_posix.0 Request processed in 204us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129370.380385:0:16812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 42 00000100:00100000:0.0:1789129370.388831:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.389234:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604604160 00000100:00100000:1.0:1789129370.389247:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604604160 00000100:00100000:1.0:1789129370.389318:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:1.0:1789129370.389331:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+25:14717:x1876037604604160:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129370.389362:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129370.389392:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58f6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aadbb expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789129370.391172:0:14818:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1789129370.391198:0:14818:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1789129370.391267:0:14818:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1789129370.391671:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ce58fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.391695:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ce58fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.391710:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ce58fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.391810:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce58f6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadbb expref: 28 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.391849:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ce58fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadbb expref: 27 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.391861:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:1.0:1789129370.391865:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789129370.391870:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030400, rc 0) 00000100:00100000:1.0:1789129370.391985:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+27:14717:x1876037604604160:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 2655us (3179us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789129370.391996:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 43 00000100:00100000:0.0:1789129370.400089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.400358:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604604416 00000100:00100000:1.0:1789129370.400373:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604604416 00000100:00100000:1.0:1789129370.400457:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:1.0:1789129370.400470:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+27:14717:x1876037604604416:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789129370.400560:0:14816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129370.400714:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030400/0x5c74554e47ce58fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadbb expref: 27 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.400735:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08d00) 00010000:00010000:1.0:1789129370.400750:0:14816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789129370.400779:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce590b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.400808:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce590b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.400821:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce590b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.400861:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce5912 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x30ba56c3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.400869:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce5912 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30ba56c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.400876:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce5912 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30ba56c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.400981:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce590b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.400989:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce590b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.400997:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce590b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401004:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129370.401009:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce590b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401019:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce590b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401028:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90b482b51300) 00010000:00010000:1.0:1789129370.401031:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129370.401035:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce590b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401042:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031800/0x5c74554e47ce590b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401059:0:14816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce5912 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30ba56c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401066:0:14816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce5912 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30ba56c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401073:0:14816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce5912 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30ba56c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401078:0:14816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129370.401081:0:14816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce5912 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30ba56c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401087:0:14816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce5912 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x30ba56c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401095:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x30ba56c3 (ffff90b4a2a08000) 00010000:00010000:1.0:1789129370.401097:0:14816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789129370.401100:0:14816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce5912 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x30ba56c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.401107:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030a00/0x5c74554e47ce5912 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x30ba56c3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129370.401227:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+26:14717:x1876037604604416:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 758us (1151us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789129370.401234:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 44 00000100:00100000:0.0:1789129370.405588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.405743:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604604544 00000100:00100000:1.0:1789129370.405757:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604604544 00000100:00100000:1.0:1789129370.405831:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:1.0:1789129370.405852:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ae5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+26:14717:x1876037604604544:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129370.405881:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129370.405915:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5919 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aadc2 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.405964:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ce5920 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.405981:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ce5920 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.405995:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ce5920 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.406117:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5919 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc2 expref: 28 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.406151:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031e00/0x5c74554e47ce5920 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc2 expref: 27 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.406162:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789129370.406165:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789129370.406169:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480031e00, rc 0) 00000100:00100000:1.0:1789129370.406248:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ae5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+27:14717:x1876037604604544:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 399us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129370.406257:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 45 00000100:00100000:0.0:1789129370.422387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.422521:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604604800 00000100:00100000:1.0:1789129370.422536:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604604800 00000100:00100000:1.0:1789129370.422660:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:1.0:1789129370.422699:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383caed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+27:14717:x1876037604604800:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789129370.422826:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.422847:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.422862:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789129370.423824:0:14816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789129370.423843:0:14816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 533521240161ns, next at 534521236425ns, rc = 0 00000004:00010000:2.0:1789129370.423983:0:14816:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009c8ffdef reply state 00000000a50ae534 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129370.423996:0:14816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789129370.424276:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383caed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+29:14717:x1876037604604800:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 1577us (1903us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789129370.424287:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 46 00000100:00100000:0.0:1789129370.433906:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129370.434192:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604604928 00000100:00100000:2.0:1789129370.434207:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604604928 00000100:00100000:2.0:1789129370.434294:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 47 00000100:00100000:2.0:1789129370.434308:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+29:14717:x1876037604604928:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789129370.434345:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129370.434376:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ba00/0x5c74554e47ce592e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aadc9 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.434512:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ba00/0x5c74554e47ce592e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc9 expref: 30 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.434531:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ba00/0x5c74554e47ce592e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc9 expref: 30 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.434560:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789129370.434564:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789129370.434569:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285ba00, rc 0) 00000100:00100000:2.0:1789129370.434685:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+30:14717:x1876037604604928:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 379us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129370.434694:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 47 00010000:00010000:1.0:1789129370.435670:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.435691:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.435701:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.435709:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480031c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:1.0:1789129370.435715:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.435725:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.435746:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789129370.435750:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789129370.435755:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.435762:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480031c00/0x5c74554e47ce5927 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129370.443349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.443681:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604605056 00000100:00100000:1.0:1789129370.443695:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604605056 00000100:00100000:1.0:1789129370.443858:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:1.0:1789129370.443874:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2370:x1876037604605056:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789129370.444516:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2370:x1876037604605056:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 643us (1177us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789129370.444528:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00080000:2.0:1789129370.444687:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129370.449771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129370.449909:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604605312 00000100:00100000:2.0:1789129370.449924:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604605312 00000100:00100000:2.0:1789129370.450011:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:2.0:1789129370.450024:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+29:14717:x1876037604605312:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789129370.450381:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+30:14717:x1876037604605312:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 358us (627us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789129370.450390:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 9 00000100:00100000:0.0:1789129370.456449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129370.456579:0:16812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604605568 00000100:00100000:3.0:1789129370.456593:0:16812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604605568 00000100:00100000:2.0:1789129370.456950:0:16812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:2.0:1789129370.456964:0:16812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+30:14717:x1876037604605568:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789129370.457117:0:16812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+30:14717:x1876037604605568:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 154us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129370.458771:0:16812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 48 00000100:00100000:0.0:1789129370.466973:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129370.470845:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604605696 00000100:00100000:2.0:1789129370.470869:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604605696 00000100:00100000:2.0:1789129370.470979:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:2.0:1789129370.470993:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+30:14717:x1876037604605696:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789129370.471029:0:14818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789129370.471063:0:14818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce5935 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aadd0 expref: -99 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.471188:0:14818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce593c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.471215:0:14818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce593c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.471232:0:14818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce593c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789129370.471298:0:14818:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789129370.471331:0:14818:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce593c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.471372:0:14818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce5935 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd0 expref: 32 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.471400:0:14818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce593c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd0 expref: 31 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.471410:0:14818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789129370.471439:0:14818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789129370.471445:0:14818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b38285b400, rc 0) 00000100:00100000:2.0:1789129370.471553:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+31:14717:x1876037604605696:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 562us (4594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129370.471561:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 49 00000100:00100000:3.0:1789129370.476496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.476663:0:16662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604605824 00000100:00100000:1.0:1789129370.476680:0:16662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604605824 00000100:00100000:1.0:1789129370.476931:0:16662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:1.0:1789129370.476944:0:16662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+6:2369:x1876037604605824:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129370.476973:0:16662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129370.477002:0:16662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5943 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aadd7 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789129370.477036:0:16662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f29a, blocks: 0x1 00010000:00010000:1.0:1789129370.477061:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1789129370.477067:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129370.477079:0:16662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd7 expref: 7 pid: 16662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.477102:0:16662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd7 expref: 7 pid: 16662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.477118:0:16662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030a00, rc 0) 00000100:00100000:1.0:1789129370.477215:0:16662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:2369:x1876037604605824:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 273us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129370.477224:0:16662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:1.0:1789129370.480981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129370.481105:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604606080 00000100:00100000:0.0:1789129370.481119:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604606080 00000100:00100000:0.0:1789129370.481204:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:0.0:1789129370.481216:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+31:14717:x1876037604606080:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789129370.481365:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+31:14717:x1876037604606080:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 151us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129370.481374:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 50 00000100:00100000:0.0:1789129370.484185:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129370.484384:0:14818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604606208 00000100:00100000:2.0:1789129370.484397:0:14818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604606208 00000100:00100000:2.0:1789129370.484465:0:14818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 51 00000100:00100000:2.0:1789129370.484477:0:14818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+31:14717:x1876037604606208:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789129370.551009:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:0.0:1789129370.551053:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1789129370.551059:0:5862:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789129370.551090:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1789129370.551101:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000100:00100000:1.0:1789129370.551317:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789129370.551344:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b654c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626616704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789129370.551435:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129370.551520:0:16811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626616704 00000100:00100000:1.0:1789129370.551527:0:16811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626616704 00000100:00100000:1.0:1789129370.551618:0:16811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789129370.551630:0:16811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1876037626616704:12345-0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1789129370.552100:0:5862:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00002000:00010000:1.0:1789129370.552237:0:16811:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789129370.552242:0:16811:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789129370.552244:0:16811:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789129370.552246:0:16811:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789129370 -> 1789129370 00002000:00010000:1.0:1789129370.552249:0:16811:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789129370.552356:0:16811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3309:x1876037626616704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 726us (918us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789129370.552366:0:16811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1789129370.552398:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129370.552578:0:14818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+14:14717:x1876037604606208:12345-192.168.201.39@tcp:44:lhsmtool_posix.0 Request processed in 68098us (68411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129370.552589:0:14818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 51 00000004:00080000:0.0:1789129370.554407:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90b4b654c3c0/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789129370.554428:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b654c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876037626616704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789129370.554864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.554978:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604606336 00000100:00100000:1.0:1789129370.554987:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604606336 00000100:00100000:1.0:1789129370.555112:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:1.0:1789129370.555123:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:2370:x1876037604606336:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789129370.555253:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:2370:x1876037604606336:12345-192.168.201.39@tcp:16:lhsmtool_posix.0 Request processed in 131us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129370.555261:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 17 00000100:00100000:1.0:1789129370.557152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129370.557252:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604606592 00000100:00100000:0.0:1789129370.557261:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604606592 00000100:00100000:0.0:1789129370.557317:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:0.0:1789129370.557327:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+14:14717:x1876037604606592:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789129370.557398:0:14816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789129370.557431:0:14816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b400/0x5c74554e47ce593c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd0 expref: 14 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.557464:0:14816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789129370.557469:0:14816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789129370.557504:0:14816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.557517:0:14816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.557526:0:14816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789129370.558092:0:14816:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009e50f641 reply state 000000003893752e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129370.558100:0:14816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789129370.558229:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+15:14717:x1876037604606592:12345-192.168.201.39@tcp:36:lhsmtool_posix.0 Request processed in 898us (1084us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789129370.558237:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 52 00000100:00100000:0.0:1789129370.560302:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00010000:00010000:2.0:1789129370.560416:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.560430:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.560438:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.560444:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490362c00 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129370.560449:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.560457:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.560477:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789129370.560480:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129370.560486:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.560492:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b490362c00/0x5c74554e47ce594a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129370.560901:0:16662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604606720 00000100:00100000:1.0:1789129370.560914:0:16662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604606720 00000100:00100000:1.0:1789129370.560974:0:16662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:1.0:1789129370.560985:0:16662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:14717:x1876037604606720:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789129370.561010:0:16662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789129370.561031:0:16662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd519138c592aadde expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.561065:0:16662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5943 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd7 expref: 8 pid: 16662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.561072:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129370.561076:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129370.561080:0:16662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 8 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.561111:0:16662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd7 expref: 8 pid: 16662 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.561135:0:16662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5943 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd7 expref: 8 pid: 16662 timeout: 633 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129370.561153:0:16662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b654f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16662:1876037626616832:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129370.561277:0:16662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860abd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789129370.564018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.564019:0:16662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b654f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16662:1876037626616832:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129370.564084:0:16662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 8 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.564114:0:16662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90b480030400, rc 0) 00000100:00100000:1.0:1789129370.564199:0:16662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+8:14717:x1876037604606720:12345-192.168.201.39@tcp:101:lhsmtool_posix.0 Request processed in 3214us (3909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129370.564210:0:16662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 18 00000100:00100000:2.0:1789129370.567993:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604606848 00000100:00100000:2.0:1789129370.568015:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604606848 00010000:00010000:2.0:1789129370.568094:0:14801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5943 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd7 expref: 8 pid: 16662 timeout: 633 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129370.568160:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 13 00000100:00100000:2.0:1789129370.568172:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+8:2370:x1876037604606848:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789129370.568203:0:14801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789129370.568235:0:14801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5943 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd7 expref: 8 pid: 16662 timeout: 633 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.568262:0:14801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5943 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd7 expref: 8 pid: 16662 timeout: 633 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.568291:0:14801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5943 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadd7 expref: 8 pid: 16662 timeout: 633 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.568314:0:14801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129370.568319:0:14801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129370.568328:0:14801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 7 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.568339:0:14801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 7 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.568421:0:14801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 7 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129370.568441:0:14801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14801:1876037626616960:192.168.201.39@tcp:105: 00000100:00100000:2.0:1789129370.568565:0:14801:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49013b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129370.579651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.579743:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604606976 00000100:00100000:1.0:1789129370.579756:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604606976 00000100:00100000:1.0:1789129370.579842:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:1.0:1789129370.579853:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+8:2369:x1876037604606976:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789129370.579887:0:14801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14801:1876037626616960:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789129370.579921:0:14801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789129370.579990:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498b21e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+8:2370:x1876037604606848:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 11820us (15988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129370.580001:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 13 00002000:00010000:1.0:1789129370.580157:0:15506:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789129370.580161:0:15506:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789129369 00002000:00010000:1.0:1789129370.580164:0:15506:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789129368 00002000:00010000:1.0:1789129370.580167:0:15506:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789129370 -> 1789129369 00002000:00010000:1.0:1789129370.580169:0:15506:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789129370.580219:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b498ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+8:2369:x1876037604606976:12345-192.168.201.39@tcp:2:lhsmtool_posix.0 Request processed in 367us (619us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789129370.580227:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 19 00000100:00100000:3.0:1789129370.583440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.583555:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604607104 00000100:00100000:1.0:1789129370.583569:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604607104 00000100:00100000:1.0:1789129370.583674:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:1.0:1789129370.583686:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+8:2367:x1876037604607104:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789129370.583765:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.583806:0:15504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 8 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.583817:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789129370.583822:0:15504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789129370.583827:0:15504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.583878:0:15504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 8 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.583903:0:15504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 8 pid: 16662 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129370.583921:0:15504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b654f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15504:1876037626617088:192.168.201.39@tcp:104: 00000100:00100000:1.0:1789129370.584012:0:15504:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4860abd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789129370.586694:0:15504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b654f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15504:1876037626617088:192.168.201.39@tcp:104: 00010000:00010000:1.0:1789129370.586746:0:15504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129370.587134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129370.587266:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604607232 00000100:00100000:3.0:1789129370.587276:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604607232 00010000:00010000:3.0:1789129370.587326:0:14803:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 9 pid: 16662 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129370.587375:0:14803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 14 00000100:00100000:3.0:1789129370.587385:0:14803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:2370:x1876037604607232:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789129370.587403:0:14803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789129370.587433:0:14803:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 9 pid: 16662 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.587458:0:14803:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 9 pid: 16662 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.587495:0:14803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0fc22ce/0x5c74554e47ce5951 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadde expref: 9 pid: 16662 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.587520:0:14803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789129370.587525:0:14803:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789129370.587532:0:14803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.587545:0:14803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.587725:0:14803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789129370.587887:0:14803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+8:2370:x1876037604607232:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 501us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129370.587897:0:14803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 14 00010000:00010000:2.0:1789129370.589413:0:15504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.589437:0:15504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.589479:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.589488:0:15504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.589498:0:15504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.589528:0:15504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030a00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129370.589533:0:15504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.589544:0:15504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.589566:0:15504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.589574:0:15504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a95235f6/0x5c74554e47ce5958 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129370.590060:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:2367:x1876037604607104:12345-192.168.201.39@tcp:1:lhsmtool_posix.0 Request processed in 6370us (6629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129370.590073:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 20 00000100:00100000:0.0:1789129370.594379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129370.594488:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604607488 00000100:00100000:2.0:1789129370.594501:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604607488 00000100:00100000:2.0:1789129370.594634:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 53 00000100:00100000:2.0:1789129370.594648:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b383cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+14:14717:x1876037604607488:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789129370.594779:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce595f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.594814:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce595f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.594856:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce595f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.595224:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.595239:0:14817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ba00/0x5c74554e47ce592e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc9 expref: 15 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.595249:0:14817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.595291:0:14817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ba00/0x5c74554e47ce592e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc9 expref: 15 pid: 14818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.595318:0:14817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ba00/0x5c74554e47ce592e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc9 expref: 15 pid: 14818 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129370.595335:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14817:1876037626617216:192.168.201.39@tcp:104: 00000100:00100000:2.0:1789129370.595444:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b49013bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789129370.605842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.605883:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604607616 00000100:00100000:1.0:1789129370.605894:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604607616 00010000:00010000:1.0:1789129370.605949:0:14801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ba00/0x5c74554e47ce592e lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc9 expref: 16 pid: 14818 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129370.606008:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 15 00000100:00100000:1.0:1789129370.606019:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+16:2370:x1876037604607616:12345-192.168.201.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789129370.606039:0:14801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789129370.606048:0:14801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ba00/0x5c74554e47ce592e lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc9 expref: 16 pid: 14818 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.606073:0:14801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ba00/0x5c74554e47ce592e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc9 expref: 16 pid: 14818 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.606101:0:14801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:1.0:1789129370.606107:0:14801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.606119:0:14801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.606134:0:14801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.606159:0:14801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789129370.606234:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+16:2370:x1876037604607616:12345-192.168.201.39@tcp:103:ldlm_bl.0 Request processed in 216us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129370.606242:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 15 00010000:00010000:3.0:1789129370.607851:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285ba00/0x5c74554e47ce592e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.39@tcp remote: 0xd519138c592aadc9 expref: 15 pid: 14818 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129370.607880:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382749a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14817:1876037626617216:192.168.201.39@tcp:104: 00010000:00010000:3.0:1789129370.607914:0:14817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.607925:0:14817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.607932:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789129370.608716:0:14817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1789129370.609096:0:14817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1789129370.609243:0:14817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1789129370.609374:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b497af21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14817:1876037626617344:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789129370.609561:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129370.609640:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4b5ab16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789129370.609780:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626617344 00000100:00100000:1.0:1789129370.609922:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626617344 00000100:00100000:1.0:1789129370.609984:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789129370.609994:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b3827483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14817:x1876037626617344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789129370.610113:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b3827483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14817:x1876037626617344:12345-0@lo:1000:mdt00_001.0 Request processed in 119us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129370.610122:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789129370.610345:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b497af21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14817:1876037626617344:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789129370.614719:0:14817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789129370.614981:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927b8780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14817:1876037626617472:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789129370.615079:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789129370.615252:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789129370.615428:0:14822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626617472 00000100:00100000:3.0:1789129370.615438:0:14822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626617472 00000100:00100000:3.0:1789129370.615593:0:14822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789129370.615638:0:14822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14817:x1876037626617472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789129370.615909:0:14822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14817:x1876037626617472:12345-0@lo:1000:mdt00_001.0 Request processed in 305us (828us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789129370.615917:0:14822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789129370.616011:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927b8780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14817:1876037626617472:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789129370.616056:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616068:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616076:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616082:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285b800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129370.616087:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616094:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616113:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:0.0:1789129370.616117:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129370.616123:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616129:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b800/0x5c74554e47ce5966 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616191:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616198:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616204:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616216:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf2800 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:0.0:1789129370.616219:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616224:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616233:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:0.0:1789129370.616235:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789129370.616243:0:14817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce58c5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadad expref: 18 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616255:0:14817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce58c5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadad expref: 18 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616265:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce58c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadad expref: 18 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.616326:0:14817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285aa00/0x5c74554e47ce58c5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.39@tcp remote: 0xd519138c592aadad expref: 18 pid: 16812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129370.616341:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927b83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14817:1876037626617600:192.168.201.39@tcp:105: 00000100:00100000:0.0:1789129370.616434:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff90b4923c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789129370.619960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129370.620651:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927b83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14817:1876037626617600:192.168.201.39@tcp:105: 00010000:00010000:2.0:1789129370.620692:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620703:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b488bf2800/0x5c74554e47ce58be lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620761:0:14817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce596d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620778:0:14817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce596d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620791:0:14817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce596d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620865:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce596d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620873:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce596d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620880:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce596d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620886:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285b000 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129370.620891:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce596d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620899:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce596d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620913:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789129370.620916:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789129370.620920:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce596d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620926:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285b000/0x5c74554e47ce596d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620942:0:14817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce595f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620949:0:14817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce595f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620955:0:14817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce595f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620959:0:14817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a200 already unused, calling callback (ffffffffc204c4f0) 00010000:00010000:2.0:1789129370.620962:0:14817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce595f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620968:0:14817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce595f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620975:0:14817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90b482b51d00) 00010000:00010000:2.0:1789129370.620977:0:14817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789129370.620979:0:14817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce595f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.620984:0:14817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b38285a200/0x5c74554e47ce595f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129370.621268:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604607744 00000100:00100000:3.0:1789129370.621278:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604607744 00000100:00100000:3.0:1789129370.621343:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:3.0:1789129370.621353:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+19:14716:x1876037604607744:12345-192.168.201.39@tcp:49:dd.0 00000100:00100000:3.0:1789129370.621523:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b487c0f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+19:14716:x1876037604607744:12345-192.168.201.39@tcp:49:dd.0 Request processed in 169us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129370.621533:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 10 00000100:00100000:2.0:1789129370.621776:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b383cad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+18:14717:x1876037604607488:12345-192.168.201.39@tcp:57:lhsmtool_posix.0 Request processed in 27131us (27417us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789129370.621785:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 53 00000020:00080000:2.0:1789129370.621789:0:14817:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789129370.622581:0:14851:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789129370.622588:0:14851:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789129370.622651:0:14851:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789129370.622658:0:14851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789129370.624737:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:3.0:1789129370.624838:0:14819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604608000 00000100:00100000:3.0:1789129370.624853:0:14819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604608000 00000100:00100000:3.0:1789129370.624923:0:14819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 11 00000100:00100000:3.0:1789129370.624935:0:14819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+18:14717:x1876037604608000:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789129370.629964:0:14819:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789129370.630084:0:14819:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789129370.630450:0:14819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.630471:0:14819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.630483:0:14819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.630492:0:14819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.630498:0:14819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789129370.630504:0:14819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.632952:0:14804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789129370.632993:0:14804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.633006:0:14804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b480030c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129370.633010:0:14804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.633021:0:14804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 5/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.633043:0:14804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90b4a2a08200) 00010000:00010000:2.0:1789129370.633046:0:14804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789129370.633052:0:14804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 3/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.633064:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129370.633066:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789129370.633069:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129370.633774:0:14819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789129370.633788:0:14819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90b480030c00/0x5c74554e47ce5974 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14819 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129370.633973:0:14819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+20:14717:x1876037604608000:12345-192.168.201.39@tcp:35:lhsmtool_posix.0 Request processed in 9033us (9245us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789129370.634016:0:14819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 11 00000020:00080000:1.0:1789129370.634031:0:14819:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789129370.645122:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789129370.782111:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.782187:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:2.0:1789129370.782323:0:15509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604608256 00000100:00100000:2.0:1789129370.782339:0:15509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604608256 00000100:00100000:3.0:1789129370.782406:0:15510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604608128 00000100:00100000:3.0:1789129370.782414:0:15510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604608128 00000100:00100000:2.0:1789129370.782447:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:2.0:1789129370.782595:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+8:2369:x1876037604608256:12345-192.168.201.39@tcp:4:dd.0 00002000:00010000:2.0:1789129370.782801:0:15509:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa3f299, atime: 0x6aa3f298, ctime: 0x6aa3f299, blocks: 0x1 00010000:00010000:2.0:1789129370.782814:0:15509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce597b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.782836:0:15509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=533s v=(0 0) 00010000:00010000:2.0:1789129370.782842:0:15509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129370.782852:0:15509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce597b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129370.782895:0:15509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce597b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789129370.789109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129370.789568:0:15511:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789129370.789581:0:15511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789129370.792132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129370.793732:0:15510:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789129370.793764:0:15510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604608512 00000100:00100000:0.0:1789129370.793797:0:15510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604608512 00000100:00100000:0.0:1789129370.793872:0:15510:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789129370.793877:0:15510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604608384 00000100:00100000:0.0:1789129370.793881:0:15510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604608384 00000100:00100000:1.0:1789129370.806426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.806553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.806582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.806611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129370.806670:0:15511:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789129370.806685:0:15511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604608768 00000100:00100000:1.0:1789129370.806698:0:15511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604608768 00000100:00100000:1.0:1789129370.806778:0:15511:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789129370.806786:0:15511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604608640 00000100:00100000:1.0:1789129370.806789:0:15511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604608640 00000100:00100000:1.0:1789129370.806813:0:15511:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789129370.806818:0:15511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604609024 00000100:00100000:1.0:1789129370.806820:0:15511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604609024 00000100:00100000:1.0:1789129370.806834:0:15511:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789129370.806840:0:15511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604608896 00000100:00100000:1.0:1789129370.806843:0:15511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604608896 00000100:00100000:3.0:1789129370.814720:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:3.0:1789129370.814750:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+15:2369:x1876037604608128:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:3.0:1789129370.814815:0:17059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5982 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.814839:0:17059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129370.814845:0:17059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129370.814853:0:17059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5982 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.814870:0:17059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5982 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789129370.927010:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1789129370.927037:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1789129370.927050:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1789129370.927065:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1789129370.927075:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:0.0:1789129370.927188:0:17059:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1789129370.927195:0:17059:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789129369 -> 1789129370 00002000:00010000:0.0:1789129370.927198:0:17059:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789129369 -> 1789129370 00002000:00010000:0.0:1789129370.927200:0:17059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:0.0:1789129370.927222:0:17059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5982 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.927239:0:17059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5982 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.927249:0:17059:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5982 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.927257:0:17059:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129370.927263:0:17059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5982 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.927275:0:17059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5982 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.927315:0:17059:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5982 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.927324:0:17059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5d24096/0x5c74554e47ce5982 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129370.927782:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+13:2369:x1876037604608128:12345-192.168.201.39@tcp:4:dd.0 Request processed in 113035us (145584us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789129370.927795:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 1 00000100:00100000:0.0:1789129370.928015:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:0.0:1789129370.928032:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+12:2369:x1876037604608512:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:0.0:1789129370.928081:0:17059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2afbca1/0x5c74554e47ce5989 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.928097:0:17059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789129370.928102:0:17059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129370.928109:0:17059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2afbca1/0x5c74554e47ce5989 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.928131:0:17059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2afbca1/0x5c74554e47ce5989 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.928853:0:15509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce597b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.928879:0:15509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce597b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.928888:0:15509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce597b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.928896:0:15509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285b000 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129370.928900:0:15509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce597b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.928908:0:15509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce597b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.928926:0:15509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce597b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.928934:0:15509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000731ba4e/0x5c74554e47ce597b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129370.929005:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+12:2369:x1876037604608256:12345-192.168.201.39@tcp:4:dd.0 Request processed in 146545us (146907us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789129370.929015:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 0 00000100:00100000:3.0:1789129370.929051:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:3.0:1789129370.929062:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+11:2369:x1876037604608384:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:3.0:1789129370.929083:0:15509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce5990 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.929099:0:15509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129370.929103:0:15509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129370.929109:0:15509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce5990 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129370.929126:0:15509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce5990 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789129370.990495:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1789129370.992359:0:17059:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:0.0:1789129370.992370:0:17059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789129370.992389:0:17059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2afbca1/0x5c74554e47ce5989 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.992406:0:17059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2afbca1/0x5c74554e47ce5989 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.992415:0:17059:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2afbca1/0x5c74554e47ce5989 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.992445:0:17059:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363c00 already unused, calling callback (ffffffffc162b550) 00010000:00010000:0.0:1789129370.992450:0:17059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2afbca1/0x5c74554e47ce5989 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.992461:0:17059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2afbca1/0x5c74554e47ce5989 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.992489:0:17059:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2afbca1/0x5c74554e47ce5989 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.992497:0:17059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2afbca1/0x5c74554e47ce5989 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789129370.992645:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+13:2369:x1876037604608512:12345-192.168.201.39@tcp:4:dd.0 Request processed in 64579us (203512us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789129370.992656:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 2 00000100:00100000:0.0:1789129370.992700:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:0.0:1789129370.992716:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+12:2369:x1876037604608768:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:0.0:1789129370.992762:0:17059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce5997 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.992777:0:17059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129370.992783:0:17059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789129370.992790:0:17059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce5997 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789129370.992830:0:17059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce5997 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789129371.077053:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1789129371.079381:0:15509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:3.0:1789129371.079392:0:15509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1789129371.079411:0:15509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce5990 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.079425:0:15509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce5990 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.079434:0:15509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce5990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.079441:0:15509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129371.079446:0:15509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce5990 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.079454:0:15509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce5990 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.079968:0:15509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce5990 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.079980:0:15509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce5990 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129371.080127:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+12:2369:x1876037604608384:12345-192.168.201.39@tcp:4:dd.0 Request processed in 151062us (288013us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789129371.080139:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 3 00000100:00100000:3.0:1789129371.080184:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:3.0:1789129371.080208:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+11:2369:x1876037604608640:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:3.0:1789129371.080246:0:15509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce599e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.080261:0:15509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129371.080266:0:15509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129371.080274:0:15509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce599e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.080300:0:15509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce599e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789129371.166922:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1789129371.167896:0:17059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1789129371.167916:0:17059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce5997 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.167944:0:17059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce5997 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.167950:0:17059:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce5997 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.167954:0:17059:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b490363600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129371.167958:0:17059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce5997 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.167965:0:17059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce5997 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.167981:0:17059:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce5997 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.167995:0:17059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc35a32/0x5c74554e47ce5997 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129371.168087:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+11:2369:x1876037604608768:12345-192.168.201.39@tcp:4:dd.0 Request processed in 175375us (361674us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789129371.168101:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 4 00000100:00100000:3.0:1789129371.168136:0:17059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 6 00000100:00100000:3.0:1789129371.168147:0:17059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+10:2369:x1876037604609024:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:3.0:1789129371.168187:0:17059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce59a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.168207:0:17059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129371.168212:0:17059:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789129371.168218:0:17059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce59a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.168230:0:17059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce59a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789129371.239516:0:15509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1789129371.239528:0:15509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:2.0:1789129371.239547:0:15509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce599e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.239562:0:15509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce599e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.239572:0:15509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce599e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.239580:0:15509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3400 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129371.239597:0:15509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce599e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.239639:0:15509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce599e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.239664:0:15509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce599e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.239673:0:15509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0abf292/0x5c74554e47ce599e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129371.239820:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+12:2369:x1876037604608640:12345-192.168.201.39@tcp:4:dd.0 Request processed in 159623us (433261us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789129371.239831:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 5 00000100:00100000:2.0:1789129371.239873:0:15509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 7 00000100:00100000:2.0:1789129371.239893:0:15509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+11:2369:x1876037604608896:12345-192.168.201.39@tcp:4:dd.0 00010000:00010000:2.0:1789129371.239931:0:15509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce59ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.239943:0:15509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129371.239947:0:15509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789129371.239953:0:15509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce59ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.239965:0:15509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce59ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789129371.242249:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:1.0:1789129371.307433:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1789129371.317629:0:17059:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1789129371.317657:0:17059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce59a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.317683:0:17059:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce59a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.317693:0:17059:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce59a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.317701:0:17059:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b488bf3600 already unused, calling callback (ffffffffc162b550) 00010000:00010000:3.0:1789129371.317707:0:17059:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce59a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.317716:0:17059:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce59a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.317739:0:17059:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce59a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789129371.317761:0:17059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006395bc3d/0x5c74554e47ce59a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789129371.317872:0:17059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+9:2369:x1876037604609024:12345-192.168.201.39@tcp:4:dd.0 Request processed in 149723us (511282us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789129371.317882:0:17059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 6 00010000:00010000:2.0:1789129371.369184:0:15509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce59ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.369207:0:15509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce59ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.369216:0:15509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce59ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.369241:0:15509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90b38285a200 already unused, calling callback (ffffffffc162b550) 00010000:00010000:2.0:1789129371.369246:0:15509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce59ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.369257:0:15509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce59ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.369277:0:15509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce59ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789129371.369286:0:15509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012514487/0x5c74554e47ce59ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789129371.369430:0:15509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+7:2369:x1876037604608896:12345-192.168.201.39@tcp:4:dd.0 Request processed in 129542us (562813us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789129371.369441:0:15509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 7 00000001:00080000:1.0:1789129371.370235:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1789129371.654589:0:16944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789129372.192237:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129372.192285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129372.192322:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129372.192360:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129372.192380:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129372.192402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:1.0:1789129372.192731:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604609152 00000100:00100000:1.0:1789129372.192742:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604609152 00000100:00100000:1.0:1789129372.192796:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:1.0:1789129372.192806:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:2367:x1876037604609152:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129372.192894:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5720850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d10bd9f-8490-482b-9659-84991f17e225+13:2367:x1876037604609152:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 88us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129372.192903:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 125 00000100:00100000:1.0:1789129372.192943:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604609408 00000100:00100000:1.0:1789129372.192946:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604609408 00000100:00100000:1.0:1789129372.192977:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604609920 00000100:00100000:1.0:1789129372.192980:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604609920 00000100:00100000:1.0:1789129372.193000:0:15506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604609536 00000100:00100000:1.0:1789129372.193002:0:15506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604609536 00000100:00100000:1.0:1789129372.193016:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1789129372.193023:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2367:x1876037604609408:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129372.193054:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2367:x1876037604609408:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 31us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129372.193061:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 21 00000100:00100000:1.0:1789129372.193074:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:1.0:1789129372.193082:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2367:x1876037604609920:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129372.193106:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2367:x1876037604609920:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 26us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129372.193113:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 22 00000100:00100000:1.0:1789129372.193124:0:15506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00100000:1.0:1789129372.193130:0:15506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2367:x1876037604609536:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129372.193170:0:15506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+5:2367:x1876037604609536:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 36us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129372.193177:0:15506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 23 00000100:00080000:1.0:1789129372.193194:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789129372.193207:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789129372.193239:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604609664 00000100:00100000:1.0:1789129372.193242:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604609664 00000100:00100000:1.0:1789129372.193274:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604609280 00000100:00100000:1.0:1789129372.193277:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604609280 00000100:00100000:1.0:1789129372.193295:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1789129372.193300:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2367:x1876037604609664:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129372.193333:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95fac8e8-2023-47db-8e7f-1db7b77a81bc+6:2367:x1876037604609664:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 33us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129372.193339:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 32 00000100:00100000:1.0:1789129372.193350:0:14816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00100000:1.0:1789129372.193355:0:14816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+20:2367:x1876037604609280:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:1.0:1789129372.193380:0:14816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6caeeb8-7d2f-4bb2-acfe-09b088540ed0+20:2367:x1876037604609280:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 25us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129372.193386:0:14816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 33 00000100:00080000:1.0:1789129372.193400:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789129372.193789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.39@tcp (source: 12345-192.168.201.39@tcp) 00000100:00100000:0.0:1789129372.194223:0:15505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037604609792 00000100:00100000:0.0:1789129372.194228:0:15505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037604609792 00000100:00100000:0.0:1789129372.194281:0:15505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00100000:0.0:1789129372.194289:0:15505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2367:x1876037604609792:12345-192.168.201.39@tcp:400:kworker.0 00000100:00100000:0.0:1789129372.194341:0:15505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5004050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95fac8e8-2023-47db-8e7f-1db7b77a81bc+5:2367:x1876037604609792:12345-192.168.201.39@tcp:400:kworker.0 Request processed in 53us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789129372.194348:0:15505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.39@tcp, seq: 24 00000100:00080000:2.0:1789129372.194756:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789129372.421980:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626618112:0@lo:400:kworker.0 00000100:00100000:0.0:1789129372.422054:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129372.422294:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626617728:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.422355:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626617984:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.422397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129372.422427:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129372.422434:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789129372.422440:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626617856:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.422464:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129372.422482:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626618368:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.422505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789129372.422537:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4927ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626618240:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.422567:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626617984 00000100:00100000:1.0:1789129372.422574:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789129372.422578:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626617984 00000100:00100000:1.0:1789129372.422647:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626617728 00000100:00100000:1.0:1789129372.422651:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626617728 00000100:00100000:1.0:1789129372.422702:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789129372.422713:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b5723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3309:x1876037626617728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.422906:0:15504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626617856 00000100:00100000:3.0:1789129372.422910:0:15504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626617856 00000100:00100000:3.0:1789129372.422936:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789129372.422943:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626617984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.423002:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626617984:12345-0@lo:400:kworker.0 Request processed in 59us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129372.423009:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789129372.423025:0:15504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789129372.423031:0:15504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626617856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.423068:0:15504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626617856:12345-0@lo:400:kworker.0 Request processed in 37us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129372.423074:0:15504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789129372.423098:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626618112 00000100:00100000:3.0:1789129372.423103:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626618112 00000100:00100000:3.0:1789129372.423130:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626618368 00000100:00100000:3.0:1789129372.423132:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626618368 00000100:00100000:3.0:1789129372.423156:0:14817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626618240 00000100:00100000:3.0:1789129372.423159:0:14817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626618240 00000100:00100000:3.0:1789129372.423177:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789129372.423183:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4927ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626618112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.423218:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4927ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876037626618112:12345-0@lo:400:kworker.0 Request processed in 36us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129372.423224:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789129372.423235:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789129372.423241:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626618368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.423346:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876037626618368:12345-0@lo:400:kworker.0 Request processed in 104us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129372.423353:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789129372.423365:0:14817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789129372.423372:0:14817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b4b654de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626618240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.423408:0:14817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b654de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876037626618240:12345-0@lo:400:kworker.0 Request processed in 37us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129372.423414:0:14817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1789129372.423431:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789129372.423436:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789129372.423438:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789129372.423480:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927bb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626617856:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.423492:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876037626618368:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.423500:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789129372.423506:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90b4b654c3c0, transno 8589934595 00000004:00080000:3.0:1789129372.423518:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789129372.423542:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b4b5723850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bfd76cf-bae1-432b-b8fe-46974cf010df+19:3309:x1876037626617728:12345-0@lo:400:kworker.0 Request processed in 830us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789129372.423562:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789129372.423713:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626617984:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.423744:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bfd76cf-bae1-432b-b8fe-46974cf010df:3309:1876037626617728:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.423755:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876037626618240:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.423911:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4927ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876037626618112:0@lo:400:kworker.0 00000100:00100000:3.0:1789129372.424990:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b382749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626618496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789129372.425061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129372.425161:0:15507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626618496 00000100:00100000:2.0:1789129372.425169:0:15507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626618496 00000100:00100000:2.0:1789129372.425220:0:15507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789129372.425230:0:15507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626618496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789129372.425940:0:15507:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1789129372.426047:0:15507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b497af21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876037626618496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 818us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789129372.426057:0:15507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789129372.426134:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b382749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876037626618496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789129372.678136:0:14804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789129373.196299:0:17097:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789129373.703065:0:14805:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789129374.729109:0:16944:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789129375.506387:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90b4b654cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626618624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789129375.506510:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789129375.506670:0:15508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876037626618624 00000100:00100000:2.0:1789129375.506680:0:15508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876037626618624 00000100:00100000:2.0:1789129375.506758:0:15508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789129375.506772:0:15508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90b38274ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626618624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789129375.506824:0:15508:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789129375.506886:0:15508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90b38274ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876037626618624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789129375.506896:0:15508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789129375.506936:0:14812:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789129375.506989:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90b4b654cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876037626618624:0@lo:13:osp-pre-0-0.0 Debug log: 31276 lines, 31276 kept, 0 dropped, 0 bad.